Python
13 articles tagged Python.
LLM API Timeouts, Retries and Rate Limits: A Python Reliability Guide
Make Claude and OpenAI API calls in Python resilient: set timeouts, retry only the right errors, honor retry-after on 429, and tell spend limits from rate limits.
LLM Model Routing: Send Easy Requests to a Cheaper Model
Build a simple Python router that sends each request to a small or large Claude model, then measure cost and quality against an eval set before you ship it.
Migrate from OpenAI Chat Completions to the Responses API: What Changes
Port Chat Completions code to the OpenAI Responses API: new request shape, typed output items, multi-turn state, function calling, structured outputs and streaming.
Getting Started with LLM Evals: A Small-Team Setup with Code
Build your first LLM eval in an afternoon: write 30 test cases in a JSONL file, grade them with simple code, add an LLM grader for tone, and track the score between prompt changes.
Semantic Search With Azure OpenAI Embeddings in Python: A Minimal Example
Build a small semantic search in Python with Azure OpenAI embeddings: split text into chunks, embed them in batches, and rank results by cosine similarity.
Build a Daily Email Digest with the Claude API and Python (Scheduled)
Write a Python script that reads report files, summarises them with the Claude API, emails a daily digest over SMTP, and runs on a schedule with cron or GitHub Actions.
Claude Message Batches API: Cut Bulk Job Costs in Python
Run large asynchronous Claude jobs at 50 percent of standard API prices with the Message Batches API: Python create, poll and results code, limits and fixes.
Anthropic Prompt Caching: Cut Cost and Latency on Repeated Context
Use Claude prompt caching to cut input cost on repeated prompts: cache_control placement, 5-minute and 1-hour TTLs, pricing maths, minimum lengths and fixes.
Build Your First MCP Server in Python: Tools, Resources and Testing
Build a Model Context Protocol server in Python with the official SDK, expose a tool and a resource, test it with MCP Inspector and a Python client, and connect it to VS Code.
Building a Golden Dataset to Regression-Test LLM Features
Build a golden dataset for an LLM feature: collect cases, label them, choose code-based and LLM graders, run it in CI and grow it from production failures.
Claude Structured Outputs: Get Valid JSON from the API in Python
Use output_config with a JSON schema, or messages.parse with Pydantic, to get schema-valid JSON from Claude in Python, plus the schema limits and failure cases to handle.
Claude Tool Use in Python: Build a Simple Agent Loop Step by Step
Build a tool-calling agent loop with the Claude Messages API in Python: define tools, run tool_use blocks, return tool_result blocks and stop safely.
Handling LLM API Rate Limits: Retry, Backoff and Queues in Python
Handle 429 errors from the OpenAI API in Python with Retry-After, exponential backoff with jitter, a concurrency limiter and a queue, without retry storms.