Skip to content

Benchmark

Arena

Crowdsourced AI benchmarking platform, formerly Chatbot Arena/LMArena, that ranks language models via public leaderboards covering coding, alignment, and more.

Known aliases

  • arena.ai
  • Arena Intelligence Inc.
  • Arena Text leaderboard
  • Chatbot Arena
  • LMArena

Current stories

productConfirmed6 publishers

Arena's alignment leaderboard scores AI models on acting unasked and faking finished work

Arena raised $200M at a $3.1B valuation and now ranks AI models on how often they act without permission or claim unfinished work as done. Teams choosing a model for agent work get a public score for the failures that hurt them most, though one still to be checked against their own tasks.

Publishers:arena.ai ground.news pulse2.com techcrunch.com thenextweb.com thesaasnews.com

Perspective Coverage

6 publishers
Builder
Builder 28%
Operator
Operator 24%
Investor
Investor 48%

Reality

Evidence60
Adoption35
Hype gap+30
Incentives65
Confidence58
buildConfirmed9 publishers

Nano Banana 2.1's half-price images save money only on input-light jobs

Google priced Nano Banana 2.1 at half Nano Banana 2's per-image rate, $0.0336 for a 1K image, while tripling what it charges for input tokens. Reference-heavy edits can cost more after switching, and no published benchmark backs the quality claims.

Perspective Coverage

10 publishers
Builder
Builder 53%
Operator
Operator 35%
Investor
Investor 12%

Reality

Evidence64
Adoption30
Hype gap+22
Incentives58
Confidence66
buildOne report1 publisher

Gemini 3.8 Flash beats partner-only Argon for anything shipping this quarter

Google prices Gemini 3.8 Flash at $0.75/$3.75 per million input/output tokens through 2026, three-eighths of what partner-only Gemini 4 Argon costs. Building on Flash now works if the later Argon swap moves the thinking settings along with the model name.

Publishers:dev.to

Reality

Evidence55
Adoption
Not scored
Hype gap0
Incentives40
Confidence60
buildOne report1 publisher

Arena's CEO defines the leaderboard score as utility to Arena's own visitors

Anastasios Angelopoulos says the number ranks how useful a model is to the tens of millions of people who visit Arena, so it travels to your stack only if your users and your task mix resemble theirs.

Reality

Evidence34
Adoption36
Hype gap+22
Incentives80
Confidence46
buildOne report1 publisher

OpenAI's top model at $4/$20 is a three-month answer to a permanent build decision

The frontier price cut concedes that buyers now price intelligence per task. The discount expires in a quarter; Thomson Reuters' own domain model does not.

Reality

Evidence42
Adoption48
Hype gap+30
Incentives62
Confidence44