Anthropic tells Newsom courts should be able to block risky AI models

Anthropic has urged California Governor Gavin Newsom to let the state ask a court to block AI models that pose a serious risk. Under its proposal, independent evaluators would report risks to the attorney general, who could seek a court order pausing a model's release, internal use or further development. OpenAI backed shutdown controls and in-house auditors but not court orders to block models.

• Anthropic's letter, dated 15 October, responds to Newsom's September executive order on AI safety
• A court could halt a model's release, its use inside the company or further work on it
• Outside auditors would work inside AI firms, paid via a state-run fund
• OpenAI backed kill switches and in-house auditors but not court orders