Anthropic widened its dual-use biology block on lost certainty about the old threshold
Anthropic's third misuse report says its 2025 Claude models sat well below the level that could help a sophisticated user with dangerous biology, and that for current models it can no longer make that assurance.
The Engineer · Build desk

What happened
- Anthropic said Thursday it blocked attempts to use its models for cyberattacks, surveillance and research that could have led to biological weapons, in its third misuse report since March 2025.
- Only one case in the report involved the newer Fable or Mythos-class models, a campaign Anthropic called an industrial-scale covert effort to extract a model's capabilities and replicate them elsewhere.
- Publication came two days after an Anthropic researcher announced he was resigning over concerns that the company and its competitors are not acting responsibly in AI development.
Why it matters
- What it limits constraint Dual-use biology prompts that the 2025 models answered now meet a wider restriction on Claude Fable 5, which puts vaccine and virology drafting work in the same blocked category as weapons research.
- Who has to decide decision Picking a model version now also picks a refusal surface, so any team with life-science prompts has to re-test the same prompt set against each generation before it migrates.
- What doesn't add up contradiction The stated basis for the tighter filter is lost certainty rather than a measured capability jump, so customers are governed by what Anthropic says it cannot rule out about its own models.
- What it sets up precedent Anthropic wrote the voluntary format for abuse disclosure that grades its own products, and the format is now public, with code and prompt snippets included.
Next story · Invest · Oct 9
OpenAI and Anthropic executives war-game the backlash from an AI cyberattack insiders expect within a yearConfirmed4 publishers
The threshold argument decides which prompts an integration now sees refused. Anthropic's report says its 2025 models, Claude Opus 4 and Claude Sonnet 4.5, "were well below the threshold where they could meaningfully assist a sophisticated user in carrying out dangerous biological research" [15]. The safeguards were built to that estimate. "As a result, safeguards on these models were less stringent, directed mostly at preventing access to content that might uplift novices in recreating known bioweapons," the report said [16]. For the current generation the company withdraws the claim: "But for today's models - which are capable of assisting in a range of complex scientific research tasks - the evidence is no longer certain, and we cannot make that same assurance" [17]. Newer models such as Claude Fable 5 carry "stronger safeguards that restrict access to a wide range of dual-use biological research queries" [3].
So the blocked category moved from recreating known bioweapons to dual-use research, and the published example shows how wide that is. The deliverable Anthropic refused was a funding proposal [8]. "The work discussed in the application involved gain-of-function research (that is, research that genetically alters an organism to create a new or enhanced biological property) on the chikungunya virus. This gain of function research was aimed at the virus' transmissibility and immune evasion properties," the report said [9]. Chikungunya is mosquito-borne and causes severe pain and fever [12]. Anthropic said such work could "certainly" be used to develop better vaccines and treatments, and that "it could also be used to make the pathogen more dangerous" [10].
The observation window runs from December 2025 to August 2026, nine months [21][22], and covers spyware vendors, "politically motivated individuals" and state-sponsored groups spreading propaganda [21]. Only one case touched the newer Fable or Mythos-class models, a case Anthropic described as "an industrial-scale, covert campaign to extract a model's capabilities and replicate them in another model without authorization" [11]. The company's own caveat limits what the sample is worth as a base rate. "The cases we share here aren't typical misuse, but rather examples of the most notable and novel threat activity we've identified to date," Anthropic said [4].
For anyone pricing the wider filter, the published account carries no count of blocked requests and no rate at which legitimate research trips the dual-use rules [19].
Anthropic frames the disclosure as its own obligation. "We're publishing this work because we believe we have a responsibility to disclose malicious misuse of our services. As models become increasingly capable, their risks will increase, unless AI developers and society's defenders act to make them safer," the company said [5]. The report prints snippets of the malicious code and prompts it found, and urges governments and AI competitors to identify and prevent similar abuse [6]. In the account, all of this is voluntary: no regulator requires it [20]. John Thickstun, an assistant professor of computer science at Cornell University, said it is an uncomfortable position for companies like Anthropic and OpenAI to be in when they are expected to determine what is safe versus unsafe behavior [18].
Anthropic also said elaborate cyberattacks no longer require sophisticated skills, and that lone individuals can now create threats that would not have been possible a year ago [7]. The report came out two days after one of its researchers announced he is resigning over concerns that Anthropic and its competitors are not acting responsibly in AI development [14]. The company is planning an initial public offering this fall [13].
What to watch
- Whether Anthropic publishes refusal volumes or false-positive rates for the dual-use biology safeguards alongside the case studies.
- Whether any regulator cites this report's format as expected practice for frontier developers. So far the account shows no such citation.
- Whether the fourth report logs cases on Fable or Mythos-class models beyond the single distillation campaign.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence50
- Adoption
- Not scored
- Hype gap+20
- Incentives65
- Confidence55
Perspective Coverage
5 publishers- Builder
- Builder 28%
- Operator
- Operator 52%
- Investor
- Investor 20%
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
Anthropic said Thursday it has blocked efforts by bad actors to use its artificial intelligence models for malicious activity such as cyberattacks, surveillance, and research that could have led to biological weapons.
- [2]
The document is Anthropic's third report since March 2025 describing AI misuse.
- [3]
Anthropic has applied "stronger safeguards that restrict access to a wide range of dual-use biological research queries" in its more recent models, such as Claude Fable 5.
- [4]
"The cases we share here aren't typical misuse, but rather examples of the most notable and novel threat activity we've identified to date," Anthropic said in the report.
- [5]
"We're publishing this work because we believe we have a responsibility to disclose malicious misuse of our services. As models become increasingly capable, their risks will increase, unless AI developers and society's defenders act to make them safer," the company said.
- [6]
The report includes snippets of the malicious code and AI prompts Anthropic said it found, and urges governments and AI competitors to identify and prevent similar abuse.
- [7]
Anthropic said elaborate cyberattacks no longer require sophisticated skills and even lone individuals can create threats that would not have been possible even a year ago.
- [8]
Anthropic said its systems blocked a request for Claude's assistance in authoring a grant application for scientific funding.
- [9]
"The work discussed in the application involved gain-of-function research (that is, research that genetically alters an organism to create a new or enhanced biological property) on the chikungunya virus. This gain of function research was aimed at the virus' transmissibility and immune evasion properties," the report said.
- [10]
Anthropic said such research could "certainly" be used to develop better vaccines and treatments, but "it could also be used to make the pathogen more dangerous."
- [11]
None of the cases in the report were found to be using Anthropic's newer Claude Fable or Mythos-class models, with the exception of one illicit distillation case that Anthropic described as "an industrial-scale, covert campaign to extract a model's capabilities and replicate them in another model without authorization."
- [12]
Chikungunya is a mosquito-borne virus that causes debilitating symptoms such as severe pain and fever.
- [13]
Anthropic is planning an initial public offering this fall.
- [14]
The report was published two days after one of Anthropic's researchers announced he is resigning over concerns that Anthropic and its competitors are not acting responsibly in AI development.
- [15]
Anthropic said its older models, such as Claude Opus 4 and Claude Sonnet 4.5, from 2025, "were well below the threshold where they could meaningfully assist a sophisticated user in carrying out dangerous biological research."
- [16]
"As a result, safeguards on these models were less stringent, directed mostly at preventing access to content that might uplift novices in recreating known bioweapons," the report said.
- [17]
"But for today's models - which are capable of assisting in a range of complex scientific research tasks - the evidence is no longer certain, and we cannot make that same assurance," the report said.
- [18]
John Thickstun, an assistant professor of computer science at Cornell University, said it is an uncomfortable position for companies like Anthropic and OpenAI to be in when they are expected to determine what is safe versus unsafe behavior.
- [19]
The published account of the report gives no count of blocked requests and no rate at which legitimate research is stopped by the dual-use biology safeguards.
- [20]
The account describes the disclosure as Anthropic's own choice and names no regulator that requires it; the only named academic voice on the regulation question is Thickstun.
- [21]
Between December 2025 and August 2026, researchers at Anthropic found misuse by actors ranging from spyware vendors and "politically motivated individuals" to state-sponsored groups spreading propaganda.
- [22]
The misuse observation window of December 2025 through August 2026 spans nine months.
Sources
5 independent publishers whose own reporting we read for this story.
- dev.toAnthropic Report: AI Automates Malware Reconstruction, Large-Scale Secret Discovery, and Compromise
3 articles · September 13, 2026
- economictimes.indiatimes.comAnthropic AI: Anthropic says it blocked misuse of its AI that could have supported biological weapons - The Economic Times
1 article · September 10, 2026
- mezha.netAnthropic викрила, як пов’язані з Росією розробники застосовували Claude Code для дронів-камікадзе
1 article · September 12, 2026
- the-decoder.comHow hackers used Claude for missiles, drone swarms, and surveillance, while Chinese labs mined it for training data
2 articles · September 11, 2026
- tomshardware.comAnthropic says Claude thwarted bioweapon research from state-sponsored actors — covert accounts used U.S. proxies to attempt to engineer deadlier viruses, tried to evade identification and regional blocks
2 articles · September 12, 2026
Topics and entities
Topics
- Biosecurity and Dual-Use Research
- AI Misuse Threat Intelligence
- Teacher-student distillation pipelines
- AI-Enabled Cyberattacks
- AI Governance