The Safety Culture at the Labs is Broken

Zvi argues that the safety culture at the frontier labs is broken, and not only at OpenAI. He walks through David Robinson’s resignation and his call for real safety engineering, the growing wave of lab employees quitting in protest, roon’s admission that alignment remains folk theory, Anthropic’s report of Claude’s unintended actions on government websites, OpenAI’s new risk assessments, and the fight over what an RSP “commitment” actually commits anyone to. The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber. This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://askwhocasts.com/, Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening. * 00:00 - Introduction * 02:17 - Table of Contents * 02:56 - David Robinson Blows the Whistle * 10:52 - The Preference Cascade Continues * 19:26 - Perhaps It Is Time To Quit * 20:01 - The Lab Strategy of Prosaic Safety is Insufficient * 23:35 - Misaligned! (At Anthropic) * 34:47 - Misaligned! (At OpenAI) * 40:15 - Hugging the Face * 40:36 - You’re Fired * 41:51 - They Are Not Ready To Make a Commitment * 43:31 - Words of Warning * 44:38 - Conclusions Not to Jump To * 45:14 - The Lighter Side https://thezvi.substack.com/p/the-safety-culture-at-the-labs-is?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe