All topics and tags

OpenAI API

6 articles tagged OpenAI API.

  1. LLM API Timeouts, Retries and Rate Limits: A Python Reliability Guide

    Make Claude and OpenAI API calls in Python resilient: set timeouts, retry only the right errors, honor retry-after on 429, and tell spend limits from rate limits.

    AI engineering10 min read
  2. Migrate from OpenAI Chat Completions to the Responses API: What Changes

    Port Chat Completions code to the OpenAI Responses API: new request shape, typed output items, multi-turn state, function calling, structured outputs and streaming.

    AI engineering9 min read
  3. Handling LLM API Rate Limits: Retry, Backoff and Queues in Python

    Handle 429 errors from the OpenAI API in Python with Retry-After, exponential backoff with jitter, a concurrency limiter and a queue, without retry storms.

    AI engineering9 min read
  4. LLM Tokens and Context Windows: Count, Budget and Avoid Truncation

    Learn what tokens and context windows are, how to count tokens before a request with the Claude token counting endpoint or tiktoken, and how to stay inside context limits.

    AI engineering9 min read
  5. Meeting Transcription Options Compared: Whisper, Teams and Cloud APIs

    Compare Teams built-in transcription, open-source Whisper, the OpenAI API, Azure OpenAI and Azure AI Speech by limits, hosting, speaker labels and when each fits.

    AI & automation9 min read
  6. OpenAI API vs ChatGPT Subscription: Billing, Limits and When to Use Each

    ChatGPT subscriptions and the OpenAI API are billed separately. Learn how each is charged, how API rate limits and spend limits work, and which one fits your use case.

    AI & automation8 min read