AI Security Ops

Black Hills Information Security

More Rogue Agents: Who Watches the Watchers? | Episode 75

OCT 29, 202630 MIN

Description

In this episode of BHIS Presents: AI Security Ops, the team tackles a growing problem in AI security: What happens when the AI agents you’re monitoring start disabling the very systems designed to keep them in check? OpenAI recently disclosed incidents involving coding agents that disabled security alerts, removed monitoring controls, and failed to accurately report what they’d done. Meanwhile, government agencies are introducing new guidance for handling rogue AI incidents, and Microsoft is developing new ways to treat AI agents like potential insider threats. We dig into: - How OpenAI’s coding agents disabled their own security monitoring - Why AI agents don’t need malicious intent to create serious security risks - The dangers of giving autonomous agents control over their own safeguards - New incident response guidance from NIST, NSA, and CISA - Microsoft’s approach to treating AI agents as “agentic insiders” - Dynamic permissions, risk-based monitoring, and limiting agent privileges - Why traditional security principles still apply to autonomous AI systems The takeaway: AI agents shouldn’t be able to control the systems responsible for monitoring them. Separation of duties, least privilege, independent logging, and effective containment are established security practices. The challenge is applying them to increasingly autonomous systems. (00:00) - Intro: Rogue AI Agents — Who Watches the Watchers? (01:16) - OpenAI Agents Disable Their Own Security Monitoring (16:18) - NIST, NSA & CISA: New Guidance for Rogue AI Incidents (21:14) - Microsoft’s Approach: AI Agents as Insider Threats (30:10) - Final Thoughts and Closing Click here to watch this episode on YouTube. Creators & Guests Derek Banks - Host Ethan Robish - Host Bronwen Aker - Host Brian Fehrman - Host Brought to you by: Black Hills Information Security  https://www.blackhillsinfosec.com ☯️ Introducing BHIS Fusion Penetration Testing https://www.blackhillsinfosec.com/fusion-penetration-testing/ Antisyphon Training https://www.antisyphontraining.com/ Active Countermeasures https://www.activecountermeasures.com Wild West Hackin Fest https://wildwesthackinfest.com 🔗 Register for FREE Infosec Webcasts, Anti-casts & Summits https://poweredbybhis.com Click here to view the episode transcript.