Topic
Standardised tests used to score model capability, together with the practice of publishing, reproducing and disputing those scores.
Artificial Analysis scores Meta's Muse Wonder Full at 56, two points behind Claude Opus 5.5 at 58. Meta's own model card has Full ahead on long-running agentic tasks, so the right pick depends on how closely your workload resembles those tasks.
Reality
Google DeepMind's table puts Gemini 4 Argon ahead of GPT-6 Astra on 14 of 19 benchmarks, with four losses and one tie, The Daily Flare reports. Astra's wins cluster in terminal tests, so coding teams should run their own workloads.
Reality
Artemis Security says Orion-1 scores 80.8 on attack reconstruction against 58.3 for the next-best model, on a benchmark it wrote. Commercial guardrails did block Hugging Face's analysis of an AI attack in July, but the test omits Anthropic's and OpenAI's strongest models.
Reality
OpenAI, Microsoft and Perplexity launched decision-model APIs within nine days at $0.10, $0.042 and $0.02 per million input tokens. Perplexity's 27B weights are Apache 2.0, so a buyer with a roughly 49 GiB GPU can self-host v1.1.
Reality
Subquadratic launched SubQ Snap at $0.05 per million input tokens with a 384K-token window, the sixth hosted decision model in about three weeks. No outside lab has run it, so every score in the launch is a claim about Subquadratic's own test set.
Reality
Google's new workhorse Flash is a model-string swap for anyone on AI Gateway, discounted through 31 December 2026. The claim worth testing is reduced tool-calling loop failures, not benchmark deltas.
Perspective Coverage
8 publishersReality
Artemis Security launched Orion-1, a model that can act on security incidents, citing an 80.8 to 58.3 lead in attack reconstruction on its own benchmark. With access limited to a private preview, whether it can take over from analyst triage is still untested.
Reality
Google prices Gemini 3.8 Flash at $0.75/$3.75 per million input/output tokens through 2026, three-eighths of what partner-only Gemini 4 Argon costs. Building on Flash now works if the later Argon swap moves the thinking settings along with the model name.
Reality
AWS's Deception Benchmark found AI vulnerability scanners catch up to 95% of real bugs but flag 41% to 99% of safe code. Its samples were built to fool models, so teams still need their own false-alarm count before sizing the triage work.
Reality
Grok 4.7 arrived on Monday after five walked-back timelines, with 40% more parameters and Grok 4.6's list price intact. Cursor's own cost chart still puts its price per task above GPT-6 Astra and Claude Sonnet 5.
Perspective Coverage
3 publishersReality
Gemini 3.8 Flash TTS and Flash-Lite TTS arrive with matching APIs, more than 2,000 stock voices and a path from a 30-second sample to a replica voice. Securing the speaker's permission is the customer's job.
Reality
The 7B open-weight model fits on an RTX 3090 and scores 60.2 on the benchmark its own developers built, against 59.82 for Google's Nano Banana 2.0. The licence shipping with it forbids commercial resale.
Reality
Every token price on Claude Opus 5.5 fell 20% except cache reads, which dropped 60% to 20 cents a million. For the advertised 40% saving to come from price alone, half a buyer's Opus 5 bill has to be cache reads.
Reality
Artificial Analysis scores GLM-5.3-Flash 42 at $0.25 a task and Kimi K3 44 at $2.00 a task. At eight-to-one on price, a two-point composite gap settles nothing, and the cost of an hour of human review decides it.
Reality
Reaching GPT-6 Astra costs a few days of patience rather than a $200 seat, so the gate worth budgeting against is Astra Pro, which Plus plans do not get, plus the credits sold on top of existing allowances.
Reality