Skip to content

Product Reports disagree2 publishers 3 min read Published Updated

Anthropic's Watermark, Not The AI Act, Is The Spec You Now Ship Against

Techdirt argues Anthropic complied with the EU AI Act more broadly than the law required. For anyone shipping model-written text, the vendor's implementation is the constraint that actually binds.

The Product Desk

Send a correction

Illustration accompanying Anthropic's Watermark, Not The AI Act, Is The Spec You Now Ship Against
Generated illustration

What happened

  • Anthropic has released more details about how its text watermarking works, and the debate over it has intensified as a result; many people are upset about it.
  • According to Techdirt, it appears that Google has already been doing something similar with the output from Gemini.
  • Generative AI is always trying to generate the next token, and it does so probabilistically rather than deterministically, so each run produces something slightly different.
  • Companies can deliberately bias a model's token selection so the tool is slightly more likely to choose certain words than it would without that bias.
  • With a long enough text and a key describing the bias, one can inspect the text and see that enough of the very slight changes match the watermark bias to suggest the text was likely generated by a model carrying that watermark.

Why it matters

Anthropic has published more detail on how its text watermarking works, and the argument about it has escalated accordingly [1]. Techdirt reports that Google already appears to be doing something similar with Gemini output, which means the practice is spreading across the model layer rather than sitting with one vendor [12].

The mechanism matters because it determines who carries the cost. Generative models pick the next token probabilistically rather than deterministically, so the same prompt yields slightly different text each run [5]. Vendors can deliberately bias that choice so the model is marginally more likely to select certain words [6]. Given a long enough passage and the key to the bias, a checker can see that enough of those small nudges line up to suggest the text came from a model carrying that watermark [7]. Techdirt describes the result as far from foolproof but capable of flagging text likely generated with that specific bias [2].

The part operators should read twice: editing the output afterwards may or may not remove the mark, depending on whether the edits change enough of the biased words [3]. That makes the marker state of any human-in-the-loop pipeline indeterminate by design [8]. You cannot tell a client, an examiner, or a compliance reviewer whether your final draft is still carrying provenance signal, because the answer depends on how much of the vocabulary your editors happened to replace.

Techdirt's central point is that Anthropic chose to comply with the law in a way that looks broader than what the law requires, for reasons the piece treats as more understandable than critics allow [11]. Practically, that shifts the governing spec. If the vendor's implementation is wider than the statute, then the thing constraining a downstream product is the implementation, not the legal text a compliance team read [9]. Reading the AI Act tells you your obligations. It does not tell you what your model provider has already stamped into your output.

The second cost is expressive range. Techdirt notes the REAL Rating site uses a one-to-five scale to distinguish degrees of AI involvement, and argues a watermark collapses all of that into a single binary question: did this use AI at all [10]. Any product that wants to disclose honestly and precisely, say, model-assisted editing versus model-authored prose, now discloses into a detection regime that cannot represent the difference. Techdirt's related worry is that this will be used to attack and denigrate people using the technology reasonably, who will be falsely accused of cheating [13].

The threat model that produced this is, by Techdirt's account, the deepfake panic. The EU rushed out its AI Act because it did not want to be slow to regulate, in the way it believes it was slow on social media [4]. Techdirt argues the deepfake fear has been largely overhyped, that it has not really materialised to date, and that most AI-modified content has been correctly identified as such [14]. The publication's conclusion is that the costs land hardest on people using the tools properly [15].

Watch whether other providers document watermarking breadth, and whether any of them expose the marker state to the customer instead of leaving it to be discovered downstream.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence60
Adoption65
Hype gap+25
Incentives50
Confidence55
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    Anthropic has released more details about how its text watermarking works, and the debate over it has intensified as a result; many people are upset about it.

    Reported SupportedView cited source
  2. [2]

    Techdirt says such a watermarking system is hardly foolproof but can call out text likely generated with that specific bias.

    Reported Supported Source: TechdirtView cited source
  3. [3]

    Editing text after the fact may or may not remove the watermark, depending on whether the edits remove or change enough of the biased words.

    Reported SupportedView cited source
  4. [4]

    As LLM tools became popular the EU rushed out its AI Act, making clear it did not want to be slow to regulate in the way it feels it should have regulated social media much earlier; part of the early concern was AI being used for deepfakes to fool people.

    Reported SupportedView cited source
  5. [5]

    Generative AI is always trying to generate the next token, and it does so probabilistically rather than deterministically, so each run produces something slightly different.

    Reported SupportedView cited source
  6. [6]

    Companies can deliberately bias a model's token selection so the tool is slightly more likely to choose certain words than it would without that bias.

    Reported SupportedView cited source
  7. [7]

    With a long enough text and a key describing the bias, one can inspect the text and see that enough of the very slight changes match the watermark bias to suggest the text was likely generated by a model carrying that watermark.

    Reported SupportedView cited source
  8. [8]

    Because removal depends on how many biased words an editor happens to change, the watermark status of a pipeline combining model generation with human editing is indeterminate.

    Derived Supported
  9. [9]

    If a vendor's watermarking implementation is broader than the statute demands, the effective constraint on downstream products is the vendor's implementation rather than the legal requirement.

    Derived Supported
  10. [10]

    Techdirt cites the REAL Rating site, which offers a one-to-five scale to make clear that not all AI use is the same, and argues that a watermark reduces all of that to a simple binary: did this use AI at all.

    Reported Supported Source: TechdirtView cited source
  11. [11]

    Techdirt says Anthropic chose to comply with the law in a manner that looks broader than what the law requires, though for reasons more understandable than some of its critics suggest.

    Reported Contested Source: TechdirtView cited source
  12. [12]

    According to Techdirt, it appears that Google has already been doing something similar with the output from Gemini.

    Reported Insufficient Source: TechdirtView cited source
  13. [13]

    Techdirt's larger concern is that watermarking will be used to attack and denigrate people who are using the technology in a reasonable manner but will be falsely accused of cheating.

    Reported Insufficient Source: TechdirtView cited source
  14. [14]

    Techdirt argues the deepfake fear has been largely overhyped and has not really materialised to date, and that most AI-modified content has been rightly called out as such.

    Reported Insufficient Source: TechdirtView cited source
  15. [15]

    Techdirt concludes that the costs of the regime will fall most heavily on the people who are using the technology properly and get the most genuine benefit from these tools.

    Reported Insufficient Source: TechdirtView cited source

Sources

2 independent publishers whose own reporting we read for this story.

  1. techcrunch.com

    1 article · August 21, 2026

    Anthropic says it will watermark text generated by its AI models
  2. techdirt.com

    1 article · August 20, 2026

    The EU Wanted A Deepfake Detector. It Got An AI Scarlet Letter.

Topics and entities