A 0.6B Qwen model and 25 lines of Python reproduce the interface TypeSafe sells as Jev
NobodyWho rebuilt the core of TypeSafe AI's Jev with a local 0.6B Qwen model and 25 lines of Python. Teams pricing Jev for routing or tool-call safety checks can test that local baseline first, provided they measure its calibration on their own labeled decisions.
The Engineer · Build desk

What happened
- Jev generates no text: the caller defines the possible answers in advance, and the model returns each one with a probability attached.
- TypeSafe AI reports that Jev runs up to 200x faster and costs 400x less than comparable LLMs on classification tasks.
- Jev's launch reached the Hacker News front page, and LangChain shipped an integration within days.
- NobodyWho's rebuild, which runs the Qwen model through llama.cpp, drew more than 450 points on Hacker News.
- The dev.to author comparing the two had not called the Jev API and worked from announcements, the LangChain writeup, the parody and two calibration critiques.
Why it matters
- Who has to decide decision With the typed-probability interface reproducible in 25 lines, a team choosing Jev is paying for its calibration and accuracy, and the test that settles it is a reliability check on the team's own labeled decisions.
- Who's exposed exposure LangChain's AutoModeMiddleware gates every tool call on Jev's answer, so swapping in an uncalibrated local model lets a dangerous call run whenever 'safe' merely outranks the other listed options.
- What it costs cost The 'for free' in the dev.to headline covers only the per-call bill; a local 0.6B model moves that cost onto hardware the team runs and maintains itself.
Next story · Build · Oct 9
Andreessen Horowitz leads a reported $870M round for Jev maker TypeSafeConfirmed7 publishers
The NobodyWho post is labeled a parody, and the code runs anyway [10]. Run it and no text is generated [6]. The script loads the Q8_0 GGUF build of Qwen3-0.6B through llama.cpp, with a 512-token context and `logits_all=True` [5]. Its prompt lists the options as A, B and C and closes on an empty `<think></think>` block [8]. A single `model.eval` call processes the prompt. The script then reads `model.scores` at the last position, the logits for whatever token would come next [6]. It keeps three of those logits, one per label, subtracts their log-sum-exp and exponentiates [6]. What comes out is a softmax over three choices. Any weight the model put on other tokens is discarded [6].
According to the dev.to post, the sample email, a payroll request for a password on a non-company sign-in page, scored 0.031 Legitimate, 0.084 Spam and 0.885 Phishing [11]. Those add to exactly 1.000 [13]. They have to, because the normalization runs over the three label tokens only [6]. The top label gets a confident-looking number even when the model's own first choice of next token lies outside the list [6]. The code also keeps only the first token of each label, the `[0]` in the source, so labels must differ in their first token [6]. Single letters do.
TypeSafe's calibration claim rests on training. It says Jev was trained with reinforcement learning for calibrated decisions, a signal that rewards honest probabilities as well as right answers [15]. On that basis TypeSafe claims a 0.7 from Jev can be treated as a real 70 percent chance [15]. The parody pulls a stock checkpoint from the Qwen/Qwen3-0.6B-GGUF repository and trains nothing [5]. Checking either model takes many labeled predictions: of all answers scored near 0.7, about seven in ten should be right [15]. NobodyWho's example scores a single email [11].
TypeSafe's speed and cost ratios are its own numbers, measured against comparable LLMs on classification tasks [14]. They transfer to a team whose current path looks like the baseline the dev.to author describes, a full frontier model writing a paragraph of reasoning for every small decision [4]. A team already reading logprobs from a small model is not on that baseline, so the ratio does not describe its savings [14][4].
In my view the local copy is the right first test for routing and for bulk scoring across thousands of rows [7]. Those are the jobs the dev.to author calls absurd uses of a frontier model's cost and latency [7].
What to watch
- Published figures from the two independent critiques of Jev's calibration, and any matching reliability test of the Qwen 0.6B copy on the same data.
- Whether TypeSafe names the baseline LLMs and workloads behind its 200x speed and 400x cost figures.
- Whether LangChain's AutoModeMiddleware lets teams swap Jev for a local logprob classifier.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence55
- Adoption55
- Hype gap+40
- Incentives60
- Confidence55
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
TypeSafe AI's Jev skips text generation: the caller defines the set of possible answers in advance and Jev returns each answer with a probability attached. TypeSafe calls it a System One model.
- [2]
Jev's launch hit the front page of Hacker News and LangChain shipped an integration within days.
- [3]
LangChain's AutoModeMiddleware uses Jev to check every tool call before it runs.
- [4]
The dev.to author says agent loops make many tiny decisions and that for each one the harness fires up a full frontier LLM, generates a paragraph of reasoning, and charges for it.
- [5]
NobodyWho's code loads Qwen3-0.6B-Q8_0.gguf from the Qwen/Qwen3-0.6B-GGUF repository via llama_cpp Llama.from_pretrained with n_ctx=512 and logits_all=True; the code shown performs no training.
- [6]
The code calls model.eval on the tokenized prompt, reads model.scores at position n_tokens - 1, takes the first token id ([0]) of each label A, B and C, subtracts numpy.logaddexp.reduce of those three logits, and exponentiates to produce probabilities.
- [7]
Use cases cited for Jev include routing requests to an agent or model and bulk classification such as sentiment, category or risk scoring across thousands of rows, where the author says a frontier model's cost and latency are absurd for the job.
- [8]
The prompt in NobodyWho's code lists options labeled A, B and C beside Legitimate, Spam and Phishing and ends the assistant turn with an empty <think></think> block.
- [9]
NobodyWho published a blog post titled "Jev in 25 lines of Python" that rebuilds Jev's core trick with a 0.6-billion-parameter Qwen model running locally through llama.cpp; it drew over 450 points on Hacker News.
- [10]
The NobodyWho post is labeled a parody, but the code is real and it runs.
- [11]
For the sample email "Payroll asks for your password on a non-company sign-in page." the output was Legitimate 0.031, Spam 0.084, Phishing 0.885.
- [12]
The dev.to author has not called the Jev API and bases the comparison on TypeSafe's announcements, the LangChain writeup, the parody post, and two independent critiques that stress-tested the calibration claims.
- [13]
The three published probabilities for the sample email sum to 1.000.
- [14]
TypeSafe reports up to 200x faster inference and 400x lower cost than comparable LLMs on classification tasks.
- [15]
TypeSafe says Jev was trained with reinforcement learning for calibrated decisions (RLCD), a training signal that rewards picking the right answer and attaching honest probabilities; TypeSafe claims that if Jev says 0.7, it can be treated as a real 70 percent chance.
- [16]
The dev.to post's headline says the 25 lines of Python do the same job as Jev for free.
Sources
2 independent publishers whose own reporting we read for this story.
- dev.toTypeSafe's Jev Costs 400x Less Than an LLM. These 25 Lines of Python Do the Same Job for Free.
2 articles · October 1, 2026
- infoq.comTypeSafe AI Releases Jev: A Decision-Only Model That Returns Typed Probabilities Instead of Text
1 article · September 30, 2026
Topics and entities
Topics
- Local and on-device inference
- Model calibration
- Agent tool-call safety
- LLM classification