Skip to content

Topic

AI Model Misuse

Use of general-purpose AI systems for harmful ends such as cyberattacks, surveillance, fraud, propaganda, or weapons research.

Current stories

productOne report1 publisher

Anthropic blocked a chikungunya grant-writing request as gain-of-function help

Anthropic says it stopped anonymous researchers who asked Claude to help write a gain-of-function grant application and to design novel venoms. Anyone shipping a science tool on a hosted model inherits that judgement call.

Publishers:fastcompany.com

Reality

Evidence34
Adoption
Not scored
Hype gap+45
Incentives70
Confidence33
investOne report1 publisher

Anthropic says Iranian security units used Claude to profile thousands of citizens

Anthropic's own threat reporting describes two separate operations using Claude to profile people connected to Iran, one of them run by paramilitary and security units against thousands of citizens.

Reality

Evidence22
Adoption25
Hype gap+45
Incentives78
Confidence28
productOne report1 publisher

Anthropic banned an account that chained Claude into an automated Navy targeting pipeline

Anthropic's misuse report describes public transponder identifiers, commercial imagery and vendor vulnerability research being assembled into targeting handbooks, and says separate missile-software requests from Yemen passed its safeguards.

Reality

Evidence45
Adoption55
Hype gap+12
Incentives70
Confidence48
productOne report1 publisher

San Francisco's city attorney orders Meta to stop allowing AI child abuse ads its review missed

New research counted roughly 350 of the ads on Meta's platforms, some built from images of real children, and lawmakers have said they will investigate. In the same week Meta launched a personal AI agent it says was built with security and privacy in mind.

Publishers:wired.com

Reality

Evidence56
Adoption58
Hype gap+12
Incentives72
Confidence48
productConfirmed7 publishers

Anthropic documents five possible bioweapons cases it cannot confirm were meant to cause harm

The 154-page threat report says actors beat the company's region blocks and hid the purpose of their research, so Anthropic banned accounts and published the pattern with every country and institution removed.

Perspective Coverage

7 publishers
Builder
Builder 35%
Operator
Operator 36%
Investor
Investor 29%

Reality

Evidence54
Adoption55
Hype gap+34
Incentives71
Confidence68