<description>&lt;div class="OutlineElement Ltr SCXW70856640 BCX0"&gt; &lt;p class="Paragraph SCXW70856640 BCX0"&gt;&lt;span class= "TextRun SCXW70856640 BCX0" lang="EN-US" xml:lang="EN-US" data-contrast="auto"&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt;Data poisoning—where adversaries tamper with training data to corrupt model behavior—poses significant risks as AI adoption expands across critical sectors. Organizations without mechanisms in place to detect or prevent data poisoning are open to&lt;/span&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt; &lt;/span&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt;an avenue &lt;/span&gt;&lt;span class="NormalTextRun SCXW70856640 BCX0"&gt;of attack that, once exploited, &lt;/span&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt;is difficult to &lt;/span&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt;remedi&lt;/span&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt;ate&lt;/span&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt;. Machine unlearning and model retraining are not always &lt;/span&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt;viable&lt;/span&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt; or effective solutions&lt;/span&gt;&lt;span class= "NormalTextRun CommentStart SCXW70856640 BCX0"&gt;. &lt;/span&gt;&lt;span class="NormalTextRun SCXW70856640 BCX0"&gt;In today's operational climate&lt;/span&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt;,&lt;/span&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt; where threat actors look to influence models and degrade the trust of users through incorrect behaviors, preventing data poisoning is more important than ever.&lt;/span&gt;&lt;/span&gt;&lt;span class="EOP SCXW70856640 BCX0" data-ccp-props="{}"&gt; &lt;/span&gt;&lt;/p&gt; &lt;/div&gt; &lt;div class="OutlineElement Ltr SCXW70856640 BCX0"&gt; &lt;p class="Paragraph SCXW70856640 BCX0"&gt;&lt;span class= "TextRun SCXW70856640 BCX0" lang="EN-US" xml:lang="EN-US" data-contrast="auto"&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt;In this episode of the SEI Podcast Series, Julie &lt;/span&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt;Lawler&lt;/span&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt; and James Cunningham—AI security researchers at Carnegie Mellon University's Software Engineering Institute—discuss the growing threat of &lt;/span&gt;&lt;/span&gt;&lt;span class="NormalTextRun SCXW70856640 BCX0" data-ccp-charstyle="Emphasis"&gt;data poisoning&lt;/span&gt;&lt;span class= "TextRun SCXW70856640 BCX0" lang="EN-US" xml:lang="EN-US" data-contrast="auto"&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt; in AI systems and highlight emerging mitigation strategies&lt;/span&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt;,&lt;/span&gt;&lt;span class= "NormalTextRun SCXW70856640 BCX0"&gt; including chain-of-custody controls. &lt;/span&gt;&lt;/span&gt;&lt;span class="EOP SCXW70856640 BCX0" data-ccp-props="{}"&gt; &lt;/span&gt;&lt;/p&gt; &lt;/div&gt;</description>

Software Engineering Institute (SEI) Podcast Series

Members of Technical Staff at the Software Engineering Institute

Protecting AI Systems Against Data Poisoning

JUN 4, 202620 MIN
Software Engineering Institute (SEI) Podcast Series

Protecting AI Systems Against Data Poisoning

JUN 4, 202620 MIN

Description

Data poisoning—where adversaries tamper with training data to corrupt model behavior—poses significant risks as AI adoption expands across critical sectors. Organizations without mechanisms in place to detect or prevent data poisoning are open to an avenue of attack that, once exploited, is difficult to remediate. Machine unlearning and model retraining are not always viable or effective solutions. In today's operational climate, where threat actors look to influence models and degrade the trust of users through incorrect behaviors, preventing data poisoning is more important than ever. In this episode of the SEI Podcast Series, Julie Lawler and James Cunningham—AI security researchers at Carnegie Mellon University's Software Engineering Institute—discuss the growing threat of data poisoning in AI systems and highlight emerging mitigation strategies, including chain-of-custody controls.