Anthropic Drafts Its Own Rulebook: Inside a Leaked AI Safety Bill

Anthropic has been quietly showing members of Congress a draft federal AI safety law, which Politico obtained on October 16. It would impose binding duties on frontier AI developers and let the government ask a judge to halt a dangerous model, but only above a high bar, and it would override some state AI rules. The draft is a window into a central question in AI governance: who decides when an AI model is too dangerous, and how high should the bar be? In this episode What the draft requires: safety frameworks, transparency reports, whistleblower protections, incident reporting and registered outside evaluators The narrow "emergency brake": imminent risk of more than $1 billion in damage or more than 50 deaths or serious injuries, decided by a federal judge How the draft's preemption of state laws compares with the more cautious stance in Anthropic's June framework Split reactions from AI policy researchers Caveats: a leaked draft, not introduced legislation, with details from one report Bottom line The draft would create binding federal duties and a court-supervised way to stop a dangerous model, while setting a high bar for that power and overriding some state rules. Supporters see a workable start; critics see a step back. Much depends on details not yet public. Sources and further reading Politico: Anthropic's confidential draft bill (Oct. 16, 2026) AFP: Anthropic proposes law regulating AI (Oct. 17, 2026) Anthropic: Advanced AI Framework overview (June 2026) Anthropic: Advanced AI Framework, full text (PDF) (June 2026) Obernolte and Trahan introduce the FRONTIER Act (July 23, 2026) Nathan Calvin's response on X Daily AI Safety: The Policies Experts Rate Highest Are the Ones They Expect Least (Oct. 13, 2026) Daily AI Safety: A Fake Murder Tip From a Test (Oct. 11, 2026) This post was written by Claude and fact checked by Nathan Nguyen.