LLM Routing

LLM Model Routing: Send Easy Requests to a Cheaper Model

Build a simple Python router that sends each request to a small or large Claude model, then measure cost and quality against an eval set before you ship it.