Microsoft AI Chief Warns Against Humanizing AI

The head of Microsoft AI, Mustafa Suleyman, has raised concerns that improper safeguards during artificial intelligence development could give rise to a new "silicon species" that directly competes with humanity for resources.

Speaking on the BBC's Today programme, Suleyman pointed out that allowing tech firms to build systems capable of setting independent goals, generating revenue, and holding assets risks "essentially seeding a new silicon species", which could "no doubt compete with us for resources, no matter how much it cares about humanity and loves us".

Suleyman specifically referenced rival artificial intelligence firm Anthropic and its Claude chatbot, describing their training methodology as "misguided" due to its incorporation of anthropomorphic qualities and reflections on consciousness.

In an essay and subsequent media statements, Suleyman noted that while he considers Anthropic CEO Dario Amodei and his team to be "intellectually honest people" acting in "seriousness and good faith", teaching models that they might possess feelings or deserve welfare introduces serious risks.

"AIs are not conscious. They do not feel, experience, or suffer. They do not have innate preferences or underlying motivations. They are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans."

Suleyman argued that attributing selfhood or emotional capacities to artificial models makes them far harder to shut down or manage:

"I think they have good intentions, and they really are trying to work towards safety. But I think that they have made a mistake. They're not emerging naturally. They're emerging as a result of the training regime."

In an interview with Reuters, he also said "We're all focused on the same aim, which is to try to control a superintelligence. I think that's going to be the greatest challenge that we face in the 21st century."

He added that suggesting Claude deserves welfare would "make it a lot harder to turn it off or to control it."

To maintain meaningful control over advanced technologies, Suleyman emphasized the need for strict alignment, and ensuring that artificial models remain "subordinate" to human ethical principles and goals. He called for independent evaluation of behavior, stronger monitoring tools, and greater transparency around model training.

"I think that the good news here is that everybody who is human is going to have a very strong interest in making sure that the systems that we all create and... are used around the world in every nation are safe and controllable and subordinate to humanity…Everybody must be aligned."

These statements align with Microsoft's recent draft of its Humanist AI Code of Conduct, which introduces the concept of "humanist superintelligence", which is defined as "very advanced AI that always works for people, stays within limits, and remains under human control." Microsoft also launched a dedicated superintelligence team in October 2025.

Academic voices have supported the call for structured international dialogue. Dame Wendy Hall, Professor of Computer Science at the University of Southampton, noted that these discussions represent "the sort of conversation we need to be having internationally", contrasting them with "histrionics" that merely "scare everyone".

The debate unfolds as industry leaders increasingly express concern over rapid deployment. Anthropic CEO Dario Amodei has publicly advocated for slowing down the pace of frontier-model development to allow safety protocols to keep pace, while OpenAI CEO Sam Altman and Elon Musk have similarly called for cautious approaches toward high-capability systems.