AI Inference Economics

Frontier Models

The most capable AI models available — and when a frontier model earns its cost vs when a small specialised model wins.

4 concepts Diagrams

Frontier models explained

Frontier models: the F1 cars of AI
Frontier models are the most capable general-purpose AI models available — Claude Opus, GPT-5, Gemini Pro. They're trained on trillions of tokens with billions of parameters at a cost of $100M+. They can reason, write, code, analyse images, and handle tasks nobody explicitly trained them to do.
Frontier modelClaude Opus, GPT-5, Gemini ProParameters100B–1T+Training cost$50M–$500M+CapabilitiesReasoning, code,vision, agentsAccessAPI (pay per token)Best forComplex, varied tasksSmall / open modelMistral 7B, Llama 8B, Qwen 7BParameters1B–14BTraining cost$1M–$10MCapabilitiesGood at defined tasks,weaker on open reasoningAccessSelf-hosted (fixed cost)Best forHigh-volume defined tasksThe question isn't "which is better?" — it's "which is right for this workload?"
The business analogy: an F1 car. Astonishing engineering, extraordinary performance, astronomical running costs. Perfect for the qualifying lap. Terrible for the school run.

Frequently asked questions

What is a frontier model?

A frontier model is one of the most capable general-purpose AI models available at any given moment — trained on trillions of tokens, with billions of parameters, at a cost north of $100M. They reason, write, code, analyse images, and handle tasks nobody explicitly trained them to do. The useful analogy is an F1 car: astonishing engineering, extraordinary performance, astronomical running costs. Perfect for the qualifying lap, terrible for the school run.

When does a frontier model earn its cost?

When the cost of a wrong answer exceeds the cost of the API call. That covers broad reasoning, novel situations, and anything that resists being reduced to a well-defined pattern — legal analysis, strategic decision support, complex customer escalations, creative work. It also covers low-volume, high-value internal use, where the token spend is trivial next to the value of the output. Where the task is well-defined and repeatable, a small model wins.

What is the difference between proprietary and open-weight frontier models?

Proprietary frontier models give you maximum capability behind a vendor API. Open-weight models — the ones you can download and self-host — give up some capability in exchange for control over deployment, cost, and data residency. The strategic question is not which scores higher on a benchmark; it is whether the capability gap is worth the lock-in, and whether your data is allowed to leave your estate at all.

What is model routing, and why do production systems use it?

Production systems do not pick one model — they route each request to the cheapest model that can handle it. Simple classification goes to a small model at a fraction of a penny; complex reasoning goes to a frontier model at fifty times the price. The router decides in milliseconds. This is how you get frontier capability without frontier costs: it turns a fixed "which model?" decision into a per-request optimisation.

Does every AI task need a frontier model?

No, and defaulting to one is the most expensive habit in enterprise AI. Using a frontier model to classify sentiment or extract fields from a form is couriering a Post-it note. Most production traffic is well-defined and repeatable, which is exactly what small specialised models are good at. Reserve the frontier tier for the fraction of requests that genuinely need it — and route the rest.

Diagrams

Embed these freely — each SVG is licensed CC BY 4.0 (opens in a new tab) with attribution to this page baked in.

AI Fundamentals Model Context Protocol