What is Smart auto-routing?
mainSmart routing is an experimental, opt-in feature that classifies user turns as either simple or strong. It automatically routes trivial turns (e.g., "ok", "rename this") to a cheaper model and non-trivial turns to a stronger model to optimize costs.
Key characteristics:
- Heuristic-based: It uses a fast heuristic (prompt length, code blocks, reasoning keywords, etc.) to classify turns. It is designed to fail safely: if it is unsure, it routes to the strong model.
- Provider-agnostic: It works by swapping models within your current provider. It does not support cross-provider routing (e.g., routing a simple turn to OpenAI and a strong turn to Anthropic).
- One decision per turn: The model is selected at the start of the turn and remains the same for the entire turn, including tool calls.
- Fallback mechanism: If a simple-routed model call fails due to a transport or server error, OpenClaude retries the turn once using the strong model.