Independent researcher Nick Cammarata, who says he left OpenAI in 2023, published a report arguing almost the entire AI network is interpretable. Business Insider calls the findings still theoretical, so safety teams have a claim to test before they have an audit method.
Reality
- Evidence38
- Adoption
- Not scored
- Hype gap+35
- Incentives
- Not scored
- Confidence55
buildConfirmed2 publishers Goodfire's Nick Cammarata says the vast majority of neurons in models up to trillions of parameters are legible, reversing an explanation he helped shape. Google DeepMind's Neel Nanda warns against overhyping it, and the model-level numbers are preliminary.
Reality
- Evidence35
- Adoption
- Not scored
- Hype gap+30
- Incentives50
- Confidence60
buildOne report1 publisher GPT-4.1 falls from 93.49% to 14.58% on BrowseComp-Plus when BM25 does the searching
GPT-4.1 scored 93.49% on BrowseComp-Plus with documents supplied and 14.58% when BM25 searched, according to The New Stack. That 78.9-point gap sizes the room for retrieval work on one fixed corpus. Production failure rates need their own measurement.
Reality
- Evidence58
- Adoption
- Not scored
- Hype gap+15
- Incentives
- Not scored
- Confidence55
buildConfirmed6 publishers Aleph Alpha released Kolibri, an Apache 2.0 German-English model that activates 3.46B of its 78.1B parameters per token. Each token costs about as much compute as a small model, yet a team hosting it in Europe still has to fit every expert in memory.
Perspective Coverage
6 publishers
- Builder
- Builder 47%
- Operator
- Operator 37%
- Investor
- Investor 16%
Reality
- Evidence72
- Adoption
- Not scored
- Hype gap+15
- Incentives65
- Confidence70
buildOne report1 publisher Removing test suspicion from reasoning traces shifts refusals in two of the open models studied
Researchers writing on LessWrong found only Nemotron 3 Super and Qwen3 32B changed refusals when test suspicion was removed from their reasoning traces. In most other models, test talk in a trace looks like general caution, so it is weak evidence of eval gaming.
Reality
- Evidence50
- Adoption
- Not scored
- Hype gap0
- Incentives
- Not scored
- Confidence45
buildOne report1 publisher Cost per shipped feature, not the leaderboard: one CTO cut a $14k model bill by $9k
A dev.to post scores ten coding models on five real tasks and divides by price. The method is cheap to copy; the vendor plumbing it recommends deserves more scrutiny than the arithmetic.
Reality
- Evidence20
- Adoption12
- Hype gap+45
- Incentives70
- Confidence55
buildOne report1 publisher Four months of A100 bills say self-hosting is a utilization bet, not a cost saving
One engineer's home lab tally: $1,400 a month for two A100s running 40% idle, against open-weight models he measured inside noise of GPT-4o. The break-even is real, and it sits high.
Reality
- Evidence22
- Adoption10
- Hype gap+36
- Incentives66
- Confidence34