Skip to content

Topic

AI Model and Agent Security

Testing, defending and monitoring AI models and agents against jailbreaks, prompt injection and out-of-scope agentic behavior.

Current stories

investConfirmed3 publishers

Anthropic links the largest of five Claude distillation campaigns to Alibaba's Qwen

Anthropic says its new defenses cut data harvested from Claude through distillation by 90 to 99 percent. Model-IP leakage and rival-lab conduct belong on the risk list for AI investors and buyers, though every figure so far is the company's own.

Perspective Coverage

3 publishers
Builder
Builder 37%
Operator
Operator 33%
Investor
Investor 30%

Reality

Evidence45
Adoption60
Hype gap+20
Incentives75
Confidence55
investConfirmed8 publishers

OpenAI says it disrupted Moonshot-linked users trying to extract its models' protected reasoning

OpenAI says it disrupted a large-scale effort by users tied to Moonshot AI to extract protected reasoning from its models. That makes three US accusers of the lab behind Kimi K3, and the published evidence so far covers attempted extraction only.

Perspective Coverage

8 publishers
Builder
Builder 33%
Operator
Operator 35%
Investor
Investor 32%

Reality

Evidence55
Adoption
Not scored
Hype gap+35
Incentives65
Confidence60
securityConfirmed3 publishers

OpenAI says a distillation campaign got its models to decrypt their own protected reasoning

OpenAI says 15,000 suspicious users had its models decode encrypted reasoning copied from other chats before it cut them off on July 28. The encryption held throughout, and the only barrier left was what the model would agree to decode.

Perspective Coverage

3 publishers
Builder
Builder 32%
Operator
Operator 43%
Investor
Investor 25%

Reality

Evidence45
Adoption
Not scored
Hype gap+20
Incentives65
Confidence55
securityOne report1 publisher

Pentagon cyber policy chief says demand for cyber options outruns the force's supply

Katie Sutton told DefenseTalks that her one priority is building more cyber options for the president and the defense secretary. She dated the department's current posture to the 2018 authorities and credited the past year with the change.

Publishers:cyberscoop.com

Reality

Evidence55
Adoption
Not scored
Hype gap+30
Incentives65
Confidence58
buildOne report1 publisher

Resold chat logs move distillation outside the origin lab's request telemetry

Bloomberg reports that US frontier labs and the US government are increasingly worried about distillation attacks, and that foreign actors are buying logs of conversations held on legitimate accounts. The detection Anthropic describes happens at request time.

Publishers:tomshardware.com

Reality

Evidence36
Adoption42
Hype gap+30
Incentives78
Confidence44
scienceOne report1 publisher

Three U.S. agencies name six China-based AI companies as distilling frontier models

The NSA, FBI and CISA say the six pulled capabilities out of Claude, GPT, Gemini and Grok variants through proxy accounts since late 2024, and they want providers watching subscription-to-usage ratios and query throughput.

Publishers:executivegov.com

Reality

Evidence50
Adoption
Not scored
Hype gap+22
Incentives68
Confidence46