Skip to content

Topic

Zero-Shot Classification

Assigning labels to inputs from written criteria alone, without task-specific training data.

Current stories

securityOne report1 publisher

Sophos wants SOCs to test TypeSafe's Jev for accuracy and calibration before it closes alerts

Sophos cites an independent test putting TypeSafe's Jev at 83% on Banking77 with no training examples, 10 points behind a trained classifier. Jev costs about a twelfth as much per email as Claude Haiku 4.5, so SOCs will be tempted to automate at a volume where small error rates add up.

Reality

Evidence55
Adoption
Not scored
Hype gap+20
Incentives40
Confidence50
buildOne report1 publisher

Featherless open-sources Simple Jev to make open models pick labels without writing text

Featherless open-sourced Simple Jev, a library that has open models pick fixed labels or yes/no answers, with hosting from $0.03 per million input tokens. CEO Eugene Cheah pitches it for classification work teams now pay frontier-model prices to run.

Publishers:thenewstack.io

Reality

Evidence35
Adoption
Not scored
Hype gap+35
Incentives75
Confidence45
scienceConfirmed3 publishers

TypeSafe's first System One model emits typed probabilities in one parallel pass

TypeSafe's Jev returns typed probability fields in a single parallel pass and, the company says, runs two orders of magnitude faster than comparable LLMs. Its published benchmark scores agreement with two large models.

Publishers:kdnuggets.com orcarouter.ai typesafe.ai

Perspective Coverage

3 publishers
Builder
Builder 54%
Operator
Operator 33%
Investor
Investor 13%

Reality

Evidence40
Adoption15
Hype gap+30
Incentives70
Confidence55
buildOne report1 publisher

250 Japanese labels put a 310M encoder 12 points ahead of a hosted decision API

On three Japanese tasks scored against the same 250 frozen rows, a fine-tuned encoder won topic classification by 12 points and tied both polarity tasks, while every zero-shot open-source model in the run lost all three.

Publishers:dev.to

Reality

Evidence58
Adoption15
Hype gap−5
Incentives45
Confidence52
leadershipOne report1 publisher

TypeSafe's own evals put Jev level with GPT-5.6 Terra at a 75th of the cost per decision

Jev returns typed answers with probability scores and no free-form text, and TypeSafe prices a decision at four hundredths of a cent. Its accuracy figures are scored against other models' probabilities.

Publishers:arize.com

Reality

Evidence34
Adoption22
Hype gap+30
Incentives68
Confidence44