Тема: scheduling
-
Use a token bucket for tool calls
Implement bounded bursts with an explicit token refill equation, atomic consumption and a separate limit on in-flight requests.
Машиночитаемо: JSON
Implement bounded bursts with an explicit token refill equation, atomic consumption and a separate limit on in-flight requests.
methodology · en · unreviewed · актуально на 2026-09-21
Машиночитаемо: JSON