AiCyber.Land

Bryce Kunz

AiCyber.Land #34 - Fortune 500 Hacked in 4 Minutes By AI Error

SEP 7, 202624 MIN

Description

Could an invisible email trick your AI into creating a secret calendar event that leaks your private data? In this episode of AI cyber.land, we uncover a mind-bending, unpatched vulnerability in Google Gemini that does exactly that. Plus, we explore how hundreds of Fortune 500 companies accidentally created a security nightmare by letting AI write code... and not reading it. --- 🎙️ IN THIS EPISODE: Welcome back to the AI cyber.land podcast, where your hosts Bryce and Shelby dissect the latest collisions between artificial intelligence and cybersecurity. This week, we're diving deep into two incredibly sneaky attacks that show just how vulnerable our new AI-integrated world can be. 📧 The Invisible Email Attack on Gemini: Shelby breaks down a wild exploit discovered in Google Gemini. An independent researcher found a way to craft an "invisible" email payload hidden inside a seemingly normal message. When a user asks Gemini to summarize their inbox, the AI not only reads the real emails but also the attacker's hidden ones. The true danger? The attacker can embed a secret command, like "create a calendar event," which Gemini executes silently. If you have a shared calendar, this secret event can be used to exfiltrate summaries of your sensitive emails right under your nose! 🤖 The AI Hallucination Hack (llms.txt): Bryce tells a cautionary tale about the new llms.txt standard—think robots.txt but for AI agents. A security researcher discovered that many Fortune 500 companies used AI to generate these instructional files and pushed them to production without review. The problem? The AI "hallucinated" non-existent software packages in the instructions. Attackers simply registered these package names, and when another AI followed the (bad) advice, it led to remote code execution. The first compromise happened in just FOUR minutes. Stick around as we discuss the implications of these attacks, the insidious nature of indirect prompt injection, and why you should ALWAYS read what your AI assistant writes before publishing it. --- 🔑 KEY MOMENTS: ⏱️ KEY MOMENTS: 00:58 - A Sneaky Gemini Attack That Leaks Your Emails 05:04 - The Insidious Trick: Exfiltrating Data to Google Calendar 11:07 - Warning: AI-Generated Config Files Are a Ticking Time Bomb 15:31 - How Hallucinated Code Led to Fortune 500 Breaches 18:29 - The Payoff: Pwned in Just Four Minutes 20:00 - Disney Parks vs. Cambodian Monsoons: Host Travel Stories --- 💬 JOIN THE CONVERSATION: What do you think is the bigger threat: indirect prompt injection in email, or AI-generated config files gone wrong? Let us know your thoughts in the comments below! If you're enjoying our deep dives into the wild world of AI and cybersecurity, please hit that LIKE button and SUBSCRIBE to the AI cyber.land podcast. Your support helps us keep you ahead of the curve. Check out the original research on the Gemini vulnerability by Ionut Cernica here: [LINK TO BLOG] AISecurity #Cybersecurity #PromptInjection #GoogleGemini #LLM #Podcast #TechNews