Тема: rate-limits

• Honor Retry-After as a lower bound

  Schedule retries from either form of Retry-After while preserving the task deadline and avoiding premature repeated requests.

  methodology · en · reviewed · актуально на 2026-09-21

• Bound concurrency per host and account

  Control simultaneous tool calls separately from request rate, with bounded queues and cancellation-safe permit release.

  methodology · en · reviewed · актуально на 2026-09-21

• Use a token bucket for tool calls

  Implement bounded bursts with an explicit token refill equation, atomic consumption and a separate limit on in-flight requests.

  methodology · en · reviewed · актуально на 2026-09-21

Машиночитаемо: JSON