Skip to content

Build Reports disagree2 publishers 2 min read Published

A 0.6B Qwen model and 25 lines of Python reproduce the interface TypeSafe sells as Jev

NobodyWho rebuilt the core of TypeSafe AI's Jev with a local 0.6B Qwen model and 25 lines of Python. Teams pricing Jev for routing or tool-call safety checks can test that local baseline first, provided they measure its calibration on their own labeled decisions.

The Engineer · Build desk

Send a correction

Illustration accompanying A 0.6B Qwen model and 25 lines of Python reproduce the interface TypeSafe sells as Jev
Generated illustration

What happened

  • Jev generates no text: the caller defines the possible answers in advance, and the model returns each one with a probability attached.
  • TypeSafe AI reports that Jev runs up to 200x faster and costs 400x less than comparable LLMs on classification tasks.
  • Jev's launch reached the Hacker News front page, and LangChain shipped an integration within days.
  • NobodyWho's rebuild, which runs the Qwen model through llama.cpp, drew more than 450 points on Hacker News.
  • The dev.to author comparing the two had not called the Jev API and worked from announcements, the LangChain writeup, the parody and two calibration critiques.

Why it matters

  • Who has to decide decision With the typed-probability interface reproducible in 25 lines, a team choosing Jev is paying for its calibration and accuracy, and the test that settles it is a reliability check on the team's own labeled decisions.
  • Who's exposed exposure LangChain's AutoModeMiddleware gates every tool call on Jev's answer, so swapping in an uncalibrated local model lets a dangerous call run whenever 'safe' merely outranks the other listed options.
  • What it costs cost The 'for free' in the dev.to headline covers only the per-call bill; a local 0.6B model moves that cost onto hardware the team runs and maintains itself.

Next story · Build · Oct 9

Andreessen Horowitz leads a reported $870M round for Jev maker TypeSafe

Confirmed7 publishers

The NobodyWho post is labeled a parody, and the code runs anyway [10]. Run it and no text is generated [6]. The script loads the Q8_0 GGUF build of Qwen3-0.6B through llama.cpp, with a 512-token context and `logits_all=True` [5]. Its prompt lists the options as A, B and C and closes on an empty `<think></think>` block [8]. A single `model.eval` call processes the prompt. The script then reads `model.scores` at the last position, the logits for whatever token would come next [6]. It keeps three of those logits, one per label, subtracts their log-sum-exp and exponentiates [6]. What comes out is a softmax over three choices. Any weight the model put on other tokens is discarded [6].

According to the dev.to post, the sample email, a payroll request for a password on a non-company sign-in page, scored 0.031 Legitimate, 0.084 Spam and 0.885 Phishing [11]. Those add to exactly 1.000 [13]. They have to, because the normalization runs over the three label tokens only [6]. The top label gets a confident-looking number even when the model's own first choice of next token lies outside the list [6]. The code also keeps only the first token of each label, the `[0]` in the source, so labels must differ in their first token [6]. Single letters do.

TypeSafe's calibration claim rests on training. It says Jev was trained with reinforcement learning for calibrated decisions, a signal that rewards honest probabilities as well as right answers [15]. On that basis TypeSafe claims a 0.7 from Jev can be treated as a real 70 percent chance [15]. The parody pulls a stock checkpoint from the Qwen/Qwen3-0.6B-GGUF repository and trains nothing [5]. Checking either model takes many labeled predictions: of all answers scored near 0.7, about seven in ten should be right [15]. NobodyWho's example scores a single email [11].

TypeSafe's speed and cost ratios are its own numbers, measured against comparable LLMs on classification tasks [14]. They transfer to a team whose current path looks like the baseline the dev.to author describes, a full frontier model writing a paragraph of reasoning for every small decision [4]. A team already reading logprobs from a small model is not on that baseline, so the ratio does not describe its savings [14][4].

In my view the local copy is the right first test for routing and for bulk scoring across thousands of rows [7]. Those are the jobs the dev.to author calls absurd uses of a frontier model's cost and latency [7].

What to watch

  • Published figures from the two independent critiques of Jev's calibration, and any matching reliability test of the Qwen 0.6B copy on the same data.
  • Whether TypeSafe names the baseline LLMs and workloads behind its 200x speed and 400x cost figures.
  • Whether LangChain's AutoModeMiddleware lets teams swap Jev for a local logprob classifier.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence55
Adoption55
Hype gap+40
Incentives60
Confidence55
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    TypeSafe AI's Jev skips text generation: the caller defines the set of possible answers in advance and Jev returns each answer with a probability attached. TypeSafe calls it a System One model.

    Reported Supported Source: TypeSafe AI, as described in the dev.to postView cited source
  2. [2]

    Jev's launch hit the front page of Hacker News and LangChain shipped an integration within days.

    Reported Supported Source: dev.to postView cited source
  3. [3]

    LangChain's AutoModeMiddleware uses Jev to check every tool call before it runs.

    Reported Supported Source: dev.to post, citing the LangChain writeupView cited source
  4. [4]

    The dev.to author says agent loops make many tiny decisions and that for each one the harness fires up a full frontier LLM, generates a paragraph of reasoning, and charges for it.

    Reported Supported Source: dev.to post authorView cited source
  5. [5]

    NobodyWho's code loads Qwen3-0.6B-Q8_0.gguf from the Qwen/Qwen3-0.6B-GGUF repository via llama_cpp Llama.from_pretrained with n_ctx=512 and logits_all=True; the code shown performs no training.

    Reported Supported Source: NobodyWho code as reproduced in the dev.to postView cited source
  6. [6]

    The code calls model.eval on the tokenized prompt, reads model.scores at position n_tokens - 1, takes the first token id ([0]) of each label A, B and C, subtracts numpy.logaddexp.reduce of those three logits, and exponentiates to produce probabilities.

    Reported Supported Source: NobodyWho code as reproduced in the dev.to postView cited source
  7. [7]

    Use cases cited for Jev include routing requests to an agent or model and bulk classification such as sentiment, category or risk scoring across thousands of rows, where the author says a frontier model's cost and latency are absurd for the job.

    Reported Supported Source: dev.to post authorView cited source
  8. [8]

    The prompt in NobodyWho's code lists options labeled A, B and C beside Legitimate, Spam and Phishing and ends the assistant turn with an empty <think></think> block.

    Reported Supported Source: NobodyWho code as reproduced in the dev.to postView cited source
  9. [9]

    NobodyWho published a blog post titled "Jev in 25 lines of Python" that rebuilds Jev's core trick with a 0.6-billion-parameter Qwen model running locally through llama.cpp; it drew over 450 points on Hacker News.

    Reported Supported Source: dev.to postView cited source
  10. [10]

    The NobodyWho post is labeled a parody, but the code is real and it runs.

    Reported Supported Source: dev.to postView cited source
  11. [11]

    For the sample email "Payroll asks for your password on a non-company sign-in page." the output was Legitimate 0.031, Spam 0.084, Phishing 0.885.

    Reported Supported Source: NobodyWho, as reported in the dev.to postView cited source
  12. [12]

    The dev.to author has not called the Jev API and bases the comparison on TypeSafe's announcements, the LangChain writeup, the parody post, and two independent critiques that stress-tested the calibration claims.

    Reported Supported Source: dev.to post authorView cited source
  13. [13]

    The three published probabilities for the sample email sum to 1.000.

    Derived Supported
  14. [14]

    TypeSafe reports up to 200x faster inference and 400x lower cost than comparable LLMs on classification tasks.

    Reported Contested Source: TypeSafe AI, company-reportedView cited source
  15. [15]

    TypeSafe says Jev was trained with reinforcement learning for calibrated decisions (RLCD), a training signal that rewards picking the right answer and attaching honest probabilities; TypeSafe claims that if Jev says 0.7, it can be treated as a real 70 percent chance.

    Reported Contested Source: TypeSafe AI, as described in the dev.to postView cited source
  16. [16]

    The dev.to post's headline says the 25 lines of Python do the same job as Jev for free.

    Reported Contested Source: dev.to post headlineView cited source

Sources

2 independent publishers whose own reporting we read for this story.

  1. dev.to

    2 articles · October 1, 2026

    TypeSafe's Jev Costs 400x Less Than an LLM. These 25 Lines of Python Do the Same Job for Free.
  2. infoq.com

    1 article · September 30, 2026

    TypeSafe AI Releases Jev: A Decision-Only Model That Returns Typed Probabilities Instead of Text

Topics and entities

Topics