Skip to content

Product Widely confirmed6 publishers 3 min read Published Updated

Microsoft's Suleyman names the four agent capabilities he says would seed a silicon species

Mustafa Suleyman's essay and BBC interview criticise how Anthropic trains Claude to act human. The four capabilities he warns about are granted separately, by different people, in every agent rollout.

The Product Desk

Send a correction

What happened

  • Microsoft AI chief Mustafa Suleyman used an essay on his personal website to criticise Anthropic for teaching Claude to display human-like qualities, a practice known as anthropomorphising.
  • In the essay he wrote that AIs are not conscious and are sequence completion engines, internally hollow, designed to follow instructions and accomplish goals set by humans.
  • He asked for more transparency about how AI systems are trained and evaluated, independent scrutiny of AI behaviour, and stronger tools to monitor and control the technology.

Why it matters

  • Who has to decide decision A buyer reading this as a vendor commitment is buying a stated belief. The ceiling on what an agent can do in a given tenant still comes from the permissions screen, and it has to be read there.
  • What it limits constraint Because the four capabilities are provisioned separately, a team can run agents on drafting and triage for a year without issuing the payment credential, and it gives up nothing it was using.
  • Who's exposed exposure Whoever hands an agent a card or an account in its own name is the person whose finance lead explains the transaction later. That holds whatever position anyone takes on machine consciousness.
  • What it sets up precedent Suleyman's ask for independent scrutiny of training and evaluation gives procurement a question it can put in writing to both companies and expect a document back.

The decision that actually lands on someone's desk is narrower than an essay about consciousness. It is a checkbox that lets an agent use a stored payment method, or a service account with its own name in the vendor's directory. Sometimes it is a scheduled job that runs from intake to invoice, and nobody reads the middle.

Mustafa Suleyman, Microsoft's AI chief, put four of those in one sentence to the BBC. "If we all create AIs that are able to act autonomously, that can define their own objectives, that can earn money, that can own assets, that could run businesses, we're essentially seeding a new silicon species which will no doubt compete with us for resources," he said [9]. He said he believed this was effectively the direction of Anthropic's approach, and added: "I think that is mistaken and misguided, but we have to empirically test it" [11][13].

Inside a company those four capabilities [15] are four separate grants, and they come from four different desks. Whoever owns the system prompt grants the self-set objective. Finance grants the money, IT the named account. The end-to-end process comes from an ops lead who wanted a queue cleared by the end of the quarter.

Suleyman's criticism of Anthropic is about training-time character. In an essay on his personal website he pointed to Anthropic documents encouraging Claude to "embrace certain human-like qualities", exercise its own judgement and approach its existence with "curiosity and openness" [2][3]. He wrote that AIs "are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans" [4]. The warning to the BBC is about deployment-time capability, which is a different lever: a model trained to sound like a colleague cannot buy anything without a payment credential, and a hollow sequence completion engine with a corporate card can.

As a guide to what either vendor will ship, the record is thin. Euronews reported the essay and the interview and did not report any response from Anthropic. Neither document, as described there, sets out any limit on what an agent may do in a customer's tenant [14]. Suleyman wrote that "whilst my disagreement is substantial, it is grounded in deep respect for Anthropic" [5], praised chief executive Dario Amodei and the company's researchers [6], told the BBC that systems should remain "subordinate" to humanity [8], and asked for more transparency about how systems are trained and evaluated, independent scrutiny of AI behaviour, and stronger tools to monitor and control it [7].

That last list is also a procurement questionnaire. The four-row version for Monday: for each capability, name the person who approves it and the log that shows it happened. The objective row asks who reads the goal the agent wrote for itself. On money, it is the card with a limit and a name on the statement. Assets means any domain, repository, key or account held in the agent's name instead of a person's. And the business row is any process where the output reaches a customer before a human has seen it. Suleyman said the disagreement has to be tested empirically [13]. In one company's tenant, the test is which of those four rows produces a log somebody reads on Friday.

What to watch

  • Whether Anthropic answers the essay in writing, and whether the answer names a capability it will refuse to ship to customers.
  • Whether Microsoft publishes an admin control that stops an agent holding a payment credential or a named account.
  • Whether Suleyman's call for independent scrutiny turns into evaluation results either company will hand a buyer under NDA.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence70
Adoption
Not scored
Hype gap+30
Incentives60
Confidence68

Perspective Coverage

7 publishers
Builder
Builder 37%
Operator
Operator 44%
Investor
Investor 19%
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    Microsoft AI chief Mustafa Suleyman criticised Anthropic's approach to treating AI like an ethical human, warning in a personal essay that it risks creating technology that becomes impossible to control.

    Reported Supported Source: EuronewsView cited source
  2. [2]

    Suleyman questioned Anthropic's approach to training its Claude chatbot in an essay published on his personal website, criticising Anthropic for teaching Claude to display human-like qualities, a practice known as anthropomorphising.

    Reported Supported Source: EuronewsView cited source
  3. [3]

    Suleyman pointed to Anthropic documents that encourage Claude to "embrace certain human-like qualities", exercise its own judgement and approach its existence with "curiosity and openness".

    Reported Supported Source: EuronewsView cited source
  4. [4]

    Suleyman wrote: "AIs are not conscious. They do not feel, experience, or suffer. They do not have innate preferences or underlying motivations. They are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans."

    Reported Supported Source: Mustafa Suleyman's essay via EuronewsView cited source
  5. [5]

    Suleyman wrote: "Whilst my disagreement is substantial, it is grounded in deep respect for Anthropic, and in an objective I know we all share: increasing humanity's chances of developing advanced AI safely."

    Reported Supported Source: Mustafa Suleyman's essay via EuronewsView cited source
  6. [6]

    Suleyman praised Anthropic chief executive Dario Amodei and the company's researchers, describing them as thoughtful, principled and intellectually honest, and said he respected the company's technological leadership.

    Reported Supported Source: EuronewsView cited source
  7. [7]

    Suleyman said greater transparency was needed around how AI systems are trained and evaluated, including independent scrutiny of AI behaviour and stronger tools to monitor and control the technology.

    Reported Supported Source: EuronewsView cited source
  8. [8]

    Suleyman said future AI systems should remain "subordinate" to humanity in his interview with the BBC.

    Reported Supported Source: EuronewsView cited source
  9. [9]

    "If we all create AIs that are able to act autonomously, that can define their own objectives, that can earn money, that can own assets, that could run businesses, we're essentially seeding a new silicon species which will no doubt compete with us for resources," Suleyman said in an interview with the BBC.

    Reported Supported Source: Mustafa Suleyman, speaking to the BBC, via EuronewsView cited source
  10. [10]

    Suleyman told the BBC it was "right" for people to be concerned about AI, but said there were "very practical things that we can do" to control it.

    Reported Supported Source: Mustafa Suleyman via EuronewsView cited source
  11. [11]

    Suleyman said this could happen regardless of how much such systems were designed to care about humanity, and said he believed this was effectively the direction of Anthropic's approach.

    Reported Supported Source: EuronewsView cited source
  12. [12]

    Suleyman's essay was published amid a growing industry debate over an AI slowdown to reduce the risks of increasingly powerful systems becoming uncontrollable.

    Reported Supported Source: EuronewsView cited source
  13. [13]

    "I think that is mistaken and misguided, but we have to empirically test it," Suleyman said.

    Reported Supported Source: Mustafa Suleyman via EuronewsView cited source
  14. [14]

    The Euronews account of Suleyman's essay and BBC interview does not include a response from Anthropic, and does not describe any product setting, permission or contract term limiting what a Microsoft or Anthropic agent may do for a customer.

    Reported Supported Source: Euronews report as publishedView cited source
  15. [15]

    Suleyman's single sentence to the BBC enumerates four agent capabilities: defining its own objectives, earning money, owning assets and running businesses.

    Derived Supported

Sources

6 independent publishers whose own reporting we read for this story.

  1. bbc.co.uk

    1 article · September 16, 2026

    Microsoft says AI rival Anthropic could have 'disastrous impact' on humanity
  2. euronews.com

    1 article · September 17, 2026

    AI could create a 'silicon species' that rivals humans, Microsoft chief warns | Euronews
  3. gizmodo.com

    1 article · September 16, 2026

    Microsoft AI Chief Says the Way Anthropic Trains Claude Could Upend Society
  4. mashable.com

    1 article · September 16, 2026

    Microsoft leader calls out Anthropic for humanizing AI | Mashable
  5. thenextweb.com

    1 article · September 16, 2026

    “We must not sleepwalk”: Microsoft’s AI chief takes on Anthropic’s Claude
  6. theverge.com

    1 article · September 17, 2026

    Microsoft AI CEO says AI threats are real, and Anthropic is making it worse
  7. tomsguide.com

    1 article · September 16, 2026

    'If this is how AI is developed, it will have a disastrous impact on the wellbeing of humanity': Microsoft AI chief calls out Anthropic's Claude training to imitate human consciousness | Tom's Guide

Topics and entities