Sophos wants SOCs to test TypeSafe's Jev for accuracy and calibration before it closes alerts
Sophos cites an independent test putting TypeSafe's Jev at 83% on Banking77 with no training examples, 10 points behind a trained classifier. Jev costs about a twelfth as much per email as Claude Haiku 4.5, so SOCs will be tempted to automate at a volume where small error rates add up.
Reality
- Evidence55
- Adoption
- Not scored
- Hype gap+20
- Incentives40
- Confidence50
buildOne report1 publisher Featherless open-sources Simple Jev to make open models pick labels without writing text
Featherless open-sourced Simple Jev, a library that has open models pick fixed labels or yes/no answers, with hosting from $0.03 per million input tokens. CEO Eugene Cheah pitches it for classification work teams now pay frontier-model prices to run.
Reality
- Evidence35
- Adoption
- Not scored
- Hype gap+35
- Incentives75
- Confidence45
TypeSafe's Jev returns typed probability fields in a single parallel pass and, the company says, runs two orders of magnitude faster than comparable LLMs. Its published benchmark scores agreement with two large models.
Perspective Coverage
3 publishers
- Builder
- Builder 54%
- Operator
- Operator 33%
- Investor
- Investor 13%
Reality
- Evidence40
- Adoption15
- Hype gap+30
- Incentives70
- Confidence55
buildOne report1 publisher 250 Japanese labels put a 310M encoder 12 points ahead of a hosted decision API
On three Japanese tasks scored against the same 250 frozen rows, a fine-tuned encoder won topic classification by 12 points and tied both polarity tasks, while every zero-shot open-source model in the run lost all three.
Reality
- Evidence58
- Adoption15
- Hype gap−5
- Incentives45
- Confidence52
TypeSafe's own evals put Jev level with GPT-5.6 Terra at a 75th of the cost per decision
Jev returns typed answers with probability scores and no free-form text, and TypeSafe prices a decision at four hundredths of a cent. Its accuracy figures are scored against other models' probabilities.
Publishers:arize.com
Reality
- Evidence34
- Adoption22
- Hype gap+30
- Incentives68
- Confidence44