What is Model Routing?
Model routing sends each request to the right model — cheap for simple work, powerful for hard work. The biggest lever on the rate side of the cost equation.
How it works
A gateway or router picks the model per request — by task, cost, or quality target.
Why it matters for cost
Routing simple work to small models cuts the rate dramatically.
Gateways (LiteLLM, One API) make it configurable.
The honest pairing
Routing cuts the rate; the firewall governs the volume. Both.
FAQ
Is routing the same as a gateway?
Routing is a gateway's core job — plus key management and caching.
Does routing replace budgets?
No — it cuts rate; caps bound volume.
Related
Stop the next $12,400 night.
One API call (or MCP tool) in front of every agent transaction — APPROVED, BLOCKED, or FLAGGED, deterministic, ~5 ms, fully logged.
See plans — from $99/mo Try a live check