EN FR

Any text in. Typed answers out.

OPEN SOURCE•RUNS LOCALLY•NO PER-CALL PRICE•AN OPEN ALTERNATIVE TO JEV
SCROLL
Daniel Kahneman, black and white portrait
DANIEL KAHNEMAN · 1934–2024
WHY “KAHN1”

Kahneman, System 1.

The name is a nod to Daniel Kahneman's System 1: fast, cheap judgments that settle most cases and route the rest before a slower System 2 (a frontier model or a person) steps in.

Kahneman, a psychologist awarded the 2002 Nobel Memorial Prize in Economic Sciences, described the two systems in Thinking, Fast and Slow (2011). System 1 is quick, automatic and intuitive; System 2 is slow, deliberate and effortful.

THREE PRIMITIVES

One state. Three typed questions.

ONE STATE

I was charged twice for order #4821 and nobody answers. Fix this before Friday or I cancel my account.

Choice

PICK ONE

What does the customer want?

refund91%
cancel6%
shipping2%
other1%

Score

ORDERED SCALE

How urgent is this?

low1%
medium8%
high71%
critical20%

Noul

TRUE / FALSE

The customer threatens to leave.

true96%
false4%
ONE STATE, THREE QUESTIONS · ILLUSTRATIVE VALUES
THE LANDSCAPE

Getting a decision out of text

LLM-BASED CLASSICAL ML

Kahn1

OPEN · LOCAL

Reads typed answers from option logits, each with a calibrated distribution. Open weights, runs on your own hardware, no per-call price. Production throughput needs a GPU, and thresholds should be recalibrated on your domain.

JEV

HOSTED API

A hosted API with strong accuracy and nothing to run yourself. Every call is paid, goes over the network and sends your data to a third party.

Other open-source LLMs

OPEN · LOCAL

General-purpose models you can run locally. They generate their answer as text, so it has to be parsed, latency grows with the output and confidence is rarely calibrated.

JSON mode

ANY CHAT MODEL

Available on almost any model or API. The model writes JSON as text: you validate and parse it, malformed answers happen and no probabilities come back.

Structured outputs

ANY CHAT MODEL

Structured decoding constrains the tokens a model generates, and the result still has to be parsed. The output fits the schema, but there is no calibrated distribution.

Classifiers

TRAINED

BERT, XGBoost… Under 1 ms to 10 ms on a CPU and strong on tabular data. The ontology is fixed: a new category means relabel, retrain, redeploy.

WHEN TO PICK WHAT

Kahn1 or classical ML?

Classical ML (BERT, XGBoost…)Kahn1
New categoryRelabel, retrain, redeployEdit the schema in the request
Labelled dataHundreds to thousands per classNone to start; some to recalibrate
LatencyUnder 1 ms to 10 ms, CPU36 ms (3B) to 89 ms (4B) median, GPU
HardwareSmall CPUs, edge devicesA GPU for production throughput
ExplanationsFeature importances, tree splitsFull distributions, no feature attribution
DeterminismSame input, same outputSame weights, prompt and kernels give the same logits; nothing is sampled
Audit trailA score or a label per decisionA full probability distribution per decision, ready to log

Pick classical ML when the ontology is fixed for years, latency must stay under 5 ms, hardware is small or the data is tabular. Pick Kahn1 when categories change often, when you start without labels, or when the signal is in free text.

HIGH-RISK DOMAINS

A decision you can't reproduce is a decision you can't defend.

A generative LLM samples its answer: ask twice, and the same case can get two different decisions. In the high-risk uses listed by the EU AI Act, such as credit scoring, hiring or access to essential services, providers must keep logs and allow human oversight. A decision that changes between runs is hard to document, audit or contest.

Kahn1 samples nothing. The same input gives the same logits, and every answer comes with its full distribution, so each decision can be replayed and logged as it was made. Low-confidence cases can be routed to a person by threshold.

Reading logits instead of parsing JSON removes format errors, not the obligations that come with using a neural model for decisions (EU AI Act, sector rules). Keep a person or a larger model on the low-confidence path, and log what was decided.

Use cases

Kahn1 is meant to be the fast first layer of a pipeline: it takes the routine decisions and hands the rest to something slower and more expensive.

01

Triage and routing

Sort tickets, emails or claims by intent, urgency and risk in one pass. To change the categories, edit the schema: no relabelling, no retraining.

02

Guardrails for agents

Before a tool call runs, ask yes/no questions about it: does it leak personal data, does it break a policy, did the user approve it? Each answer is a probability you can gate on.

03

Document scoring

Rate tone, urgency, complexity or quality as continuous expected values rather than coarse labels, and index documents on them.

04

Selective escalation

Automate the confident cases and send the rest to a larger model or a person. With calibrated confidence, the threshold becomes a risk decision you can measure.

05

Cold start

A new product line or a new taxonomy works zero-shot on day one. Recalibrate on your own labelled examples with sysone calibrate once you have them.

06

Control loops

One Choice per tick can drive a policy: Kahn1 plays Snake as well as a greedy heuristic, provided the state spells out what lies around the head.

CAVEATS

Read this before real decisions

Kahn1 comes in two sizes, 4 and 3 billion parameters. Read this before putting either in front of real decisions.

  1. It is not a frontier model.
  2. Accuracy depends on the primitive.
  3. Calibration holds on its own distribution.
  4. Confidence is not the probability of being right.
  5. Deterministic computation is not deterministic truth.
  6. Regulation still applies.
  7. The speed comes from engineering.
  8. The browser demos run an older checkpoint.
READ THE FULL CAVEATS →