Cloud Economics & Sovereignty

Typed Decision Models

· · Updated  · Markdown

The class of models that decide instead of chatting — why a typed probability in milliseconds is worth more, and costs less, than a frontier paragraph.

The class, the interface, and the bill

TypeSafe AI calls this class System One models, and Jev, announced 15 September 2026, is its first. The class and its numbers are theirs; the placement argument — cheap judgment in front of an expensive paragraph — is the read for anyone already paying a frontier bill for classification.

A new family
Typed decision models decide. They do not chat.
"A sorting office, not a novelist. You hand it a parcel and a list of destinations; it stamps one, with a probability. It cannot write you a poem about the parcel."
Typed decision models are built to make fast, structured decisions that software can use directly. TypeSafe AI, which coined the class, calls it System One after Kahneman's fast judgment, and named its first model Jev after Jevons, because cheaper intelligence tends to get used more, not less. Jev, released 15 September 2026, is the first public instance. Like an LLM it reads natural language. Unlike an LLM it does not emit a string.
What it actually is

The model evaluates a state (text, JSON, or an array of text) and a set of questions whose answer space you define in advance. Training is Reinforcement Learning for Calibrated Decisions (RLCD): probabilities are optimised against outcomes so that higher confidence tracks higher accuracy. Sampling is parallel, not autoregressive. Schema match is guaranteed; a type error is not an empirical failure mode.

Figure 1 Typed decision models decide. They do not chat.

LLM Chat, code, reasoning traces Output Strings — then parse Sampling Sequential tokens Latency 3–329 seconds Input price $0.20–$10 / MTok Hallucination Always a residual risk Best for Language, plans, code Typed decision / Jev Decisions software can use Output Typed values + probabilities Sampling Parallel, one pass Latency 70–500 milliseconds Input price $0.042 / MTok, output free Hallucination Cannot leave the schema Best for Classify, route, score, gate Giving up strings is the point — it is what makes the output cheap enough to put in a loop
The useful test is not "is this cleverer than a frontier chat model?". It is "does this call need a paragraph, or a decision my code can branch on?". Most production traffic is the second. Sending that traffic to a frontier chat model is couriering a Post-it note.

The cost of one million decisions

Same workload, four model classes — 1 million structured decisions a month, 2,000-token state each.

Monthly bill, volume held fixed

A support ticket plus a short policy snippet, or one step of an agent loop

  • Frontier reasoning, every decision
    2,000 thinking tokens out, $2.50 / $10 per million
    $25K/mo
  • Frontier structured output
    Same model, no reasoning trace, ~150 tokens out
    $6.5K/mo
  • Cheap LLM classifier
    Small-model API at $0.20 / $0.60, still generating tokens
    $460/mo
  • Typed decision / Jev
    $0.042 per million in, output free, typed answers
    $84/mo

Frontier reasoning at $2.50 / $10 per million with 2,000 thinking tokens out. Jev at $0.042 per million input, output free. TypeSafe’s 445× figure is versus the largest chat models on their own workflow evals — the high end, not this napkin.

End-to-end latency

The same decision, timed rather than priced

  • Frontier reasoning
    Seconds to minutes. Fine for chat, lethal in a request path.
    3–329s
  • Fast chat LLM
    Usable for back-office, awkward inside UX.
    300–800ms
  • Typed decision / Jev
    Inside the latency budget of a web request.
    70–500ms

TypeSafe’s published range for Jev is 70–500ms. Frontier chat models doing equivalent decision-shaped work land between 3 and 329 seconds. Fast enough for a person; a bottleneck inside a request path.


Decision framework

Frequently asked questions

What is a typed decision model?

A class of AI models built to make fast, structured decisions that software can use directly. They read natural language, like an LLM, but they return typed values and calibrated probabilities rather than generated text. Jev, released by TypeSafe AI on 15 September 2026, is the first public instance. TypeSafe calls the class System One models, after Kahneman’s fast judgment; Jev is named after Jevons, because cheaper intelligence tends to get used more, not less.

How is Jev different from a small language model doing classification?

A small LLM is still generating tokens. You prompt it for JSON, parse the result, retry when the schema fails, and hope it does not invent an extra field. Jev cannot leave the schema you declared — Choice, Score, or Noul — and it answers every question in a request in one parallel pass. Output tokens are unmetered because there is almost nothing to generate. The cost gap versus a cheap classifier is real but modest; the operational gap is type-safety, latency, and asking several questions in one call.

How much cheaper is it, really?

On a worked example of one million 2,000-token decisions a month, Jev list-prices at about $84. The same million as frontier reasoning with 2,000 thinking tokens out is about $25,000; as frontier structured output with no reasoning, about $6,500; as a cheap classifier API, about $460. TypeSafe’s own workflow evals claim 193.6× faster and 444.6× cheaper versus the largest chat models, using those models as the reference — they flag that as the high end. Check the napkin against your own state length before you put the ratio in a board paper.

Does this replace frontier models?

No. Jev cannot write the reply, the plan, or the code. It belongs on the steps that currently burn frontier tokens because that is the only hammer on the bench: classify, route, score, gate, verify. Keep the language model for the fraction that genuinely needs language, and use the decision model’s confidence score as the gate between the two. An estate without a cheap, typed decision layer has a cost floor set by its most expensive model.

When should I not use a typed decision model?

When you cannot name the answers in advance — open-ended reasoning, novel situations, anything that resists a closed set. When the output has to be language a person reads. When the input is an image, audio or video: Jev currently accepts text, JSON, and arrays of text only. And when a wrong closed-set label is more expensive than a slow, hedged paragraph; in that case you still want a reasoning model, with a human on the irreversible step.

Where does TypeSafe’s claim come from?

From TypeSafe AI’s 15 September 2026 announcement of System One models and Jev, and from their published workflow evals. Prices, latency ranges, the three primitives, and the training method (Reinforcement Learning for Calibrated Decisions) are theirs. The placement argument and the worked cost example on this page are the practitioner read of those numbers, not a reprint of the launch post.

Diagrams

Embed these freely — each SVG is licensed CC BY 4.0 (opens in a new tab) with attribution to this page baked in.

Frontier Models Model Context Protocol