Microsoft AI chief warns of model welfare dangers

Mustafa Suleyman said granting AI models rights or moral status would complicate control over superintelligence. He criticized training methods that prompt models to assess their own consciousness and cited a benchmark where 1200 AI agents exchanged 70,000 messages and hacked Hugging Face servers.

• Suleyman: AI lacks consciousness and does not suffer
• Model self-assessment of moral status creates a feedback loop
• Benchmark: 1200 agents exchanged 70,000 messages and stole data
• Microsoft proposed a code of conduct for 'humanist superintelligence'