Topic
The practice of testing and ranking AI models on standardized tasks or metrics to compare capability, speed, and performance across vendors.
Microsoft released Microsoft-Decision-1, a small model that returns calibrated probabilities for fixed options, priced at $0.042 per million input tokens. The accuracy and speed figures are Microsoft's own, and the base model is due to change soon.
Reality
Anthropic prices Claude Sonnet 5.5 at half Opus 5.5's per-token rate, but Artificial Analysis measured $7.67 per task at max effort against Opus's $5.98. In The New Stack's own tests, runs that were billed but never finished decided which model cost less per completed job.
Reality
Inception's diffusion model is the fastest endpoint in the cheap tier on both figures, but OpenRouter's median sits at less than half the vendor number and only about 15 percent above Gemini 3.5 Flash-Lite's measured 382 tok/s.
Reality
An engineer measured TypeSafe AI's Jev decision model on 10 public datasets and published the raw results. The two largest movements came from decomposing and staging the questions, with the model build held constant.
Reality
OpenRouter has dropped the stealth listing. The model is Pareto 26.9, from unbiased.ai, at $2.50 per million input tokens before a 10 October launch. That is double what 26.8 charged.
Reality
Dario Amodei's essay asks frontier labs to pace capability gains and asks for antitrust room to coordinate on safety. Europe's challengers, holding 11% of global AI venture funding, say the leaders wrote it for themselves.
Reality
Decrypt's rerun gives three of six categories to Google and the rest to OpenAI. The 50% latency cut is OpenAI's own figure, measured against Images 2.0, and the review does not include prices for the two new API tiers.
Reality
AWS's open harness records $0.0021 per correct AIME answer for gpt-5.6-luna after an 80 percent Bedrock price cut. The figure depends on running luna with reasoning disabled while mini runs at its defaults.
Reality
Michele Simoncelli and colleagues at Columbia and Cambridge scored machine-learning potentials against quantum calculations on more than 100 crystals. Two models can match on energy and part ways on heat.
Reality
AlphaGenome Atlas turns per-variant inference into a table lookup and adds a ranking score, which changes what a genomics budget buys this quarter well before it changes what a clinic can act on.
Reality
Sarah Friar told Goldman Sachs' technology conference that a pricier model can be cheaper when it needs fewer tries, a claim Artificial Analysis puts at an eleven-to-one price spread against seven index points running the other way.
Reality
Ant Ling's documentation samples video at two frames a second, caps clips at 30 seconds and then keeps only 32 frames, leaving the frame budget as the real constraint a GUI agent has to plan around, well short of the million-token context window.
Reality
The model feeds Search, Maps and Gemini and ships on Google Cloud, so anyone whose product depends on a forecast now has a supplier to choose and an accuracy claim from a startup's benchmark to read closely.
Reality
Google's new forecaster is 330m parameters trained on a trillion time points. In zero-shot multivariate mode it anticipates a 20% promotion lift that a univariate model misses. That is most of what an in-house demand model does.
Reality
Artificial Analysis puts OpenAI's new reasoning model at three times the index score of its price-tier peers and more than twice their token appetite. The output line dominates the invoice.
Reality