All topics and tags

Rate Limits

2 articles tagged Rate Limits.

  1. Handling LLM API Rate Limits: Retry, Backoff and Queues in Python

    Handle 429 errors from the OpenAI API in Python with Retry-After, exponential backoff with jitter, a concurrency limiter and a queue, without retry storms.

    AI engineering9 min read
  2. OpenAI API vs ChatGPT Subscription: Billing, Limits and When to Use Each

    ChatGPT subscriptions and the OpenAI API are billed separately. Learn how each is charged, how API rate limits and spend limits work, and which one fits your use case.

    AI & automation8 min read