<description>Summary&lt;br /&gt;In this episode of the Data Engineering Podcast Gleb Mezhanskiy, CEO and co-founder of DataFold, talks about the intersection of AI and data engineering. He discusses the challenges and opportunities of integrating AI into data engineering, particularly using large language models (LLMs) to enhance productivity and reduce manual toil. The conversation covers the potential of AI to transform data engineering tasks, such as text-to-SQL interfaces and creating semantic graphs to improve data accessibility, and explores practical applications of LLMs in automating code reviews, testing, and understanding data lineage.&lt;br /&gt;&lt;br /&gt;&lt;br /&gt;Announcements&lt;br /&gt;&lt;ul&gt;&lt;li&gt;Hello and welcome to the Data Engineering Podcast, the show about modern data management&lt;/li&gt;&lt;li&gt;Data migrations are brutal. They drag on for months—sometimes years—burning through resources and crushing team morale. Datafold's AI-powered Migration Agent changes all that. Their unique combination of AI code translation and automated data validation has helped companies complete migrations up to 10 times faster than manual approaches. And they're so confident in their solution, they'll actually guarantee your timeline in writing. Ready to turn your year-long migration into weeks? Visit &lt;a href="https://www.dataengineeringpodcast.com/datafold" target="_blank"&gt;dataengineeringpodcast.com/datafold&lt;/a&gt; today for the details.&amp;nbsp;&lt;/li&gt;&lt;li&gt;Your host is Tobias Macey and today I'm interviewing Gleb Mezhanskiy about&amp;nbsp;&lt;/li&gt;&lt;/ul&gt;Interview&lt;br /&gt;&lt;ul&gt;&lt;li&gt;Introduction&lt;/li&gt;&lt;li&gt;How did you get involved in the area of data management?&lt;/li&gt;&lt;li&gt;modern data stack is dead&lt;/li&gt;&lt;li&gt;where is AI in the data stack?&lt;/li&gt;&lt;li&gt;"buy our tool to ship AI"&lt;/li&gt;&lt;li&gt;opportunities for LLM in DE workflow&lt;/li&gt;&lt;/ul&gt;Contact Info&lt;br /&gt;&lt;ul&gt;&lt;li&gt;&lt;a href="https://www.linkedin.com/in/glebmezh/" target="_blank"&gt;LinkedIn&lt;/a&gt;&lt;/li&gt;&lt;/ul&gt;Parting Question&lt;br /&gt;&lt;ul&gt;&lt;li&gt;From your perspective, what is the biggest gap in the tooling or technology for data management today?&lt;/li&gt;&lt;/ul&gt;Closing Announcements&lt;br /&gt;&lt;ul&gt;&lt;li&gt;Thank you for listening! Don't forget to check out our other shows. &lt;a href="https://www.pythonpodcast.com" target="_blank"&gt;Podcast.__init__&lt;/a&gt; covers the Python language, its community, and the innovative ways it is being used. The &lt;a href="https://www.aiengineeringpodcast.com" target="_blank"&gt;AI Engineering Podcast&lt;/a&gt; is your guide to the fast-moving world of building AI systems.&lt;/li&gt;&lt;li&gt;Visit the &lt;a href="https://www.dataengineeringpodcast.com" target="_blank"&gt;site&lt;/a&gt; to subscribe to the show, sign up for the mailing list, and read the show notes.&lt;/li&gt;&lt;li&gt;If you've learned something or tried out a project from the show then tell us about it! Email hosts@dataengineeringpodcast.com with your story.&lt;/li&gt;&lt;/ul&gt;Links&lt;br /&gt;&lt;ul&gt;&lt;li&gt;&lt;a href="https://www.datafold.com/" target="_blank"&gt;Datafold&lt;/a&gt;&lt;/li&gt;&lt;li&gt;&lt;a href="https://github.com/features/copilot" target="_blank"&gt;Copilot&lt;/a&gt;&lt;/li&gt;&lt;li&gt;&lt;a href="https://www.cursor.com/" target="_blank"&gt;Cursor IDE&lt;/a&gt;&lt;/li&gt;&lt;li&gt;&lt;a href="https://www.ibm.com/think/topics/ai-agents" target="_blank"&gt;AI Agents&lt;/a&gt;&lt;/li&gt;&lt;li&gt;&lt;a href="https://datachat.ai/" target="_blank"&gt;DataChat&lt;/a&gt;&lt;ul&gt;&lt;li&gt;&lt;a href="https://www.aiengineeringpodcast.com/datachat-llm-product-business-episode-31" target="_blank"&gt;AI Engineering Podcast Episode&lt;/a&gt;&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;li&gt;&lt;a href="https://www.ssp.sh/brain/metrics-layer/" target="_blank"&gt;Metrics Layer&lt;/a&gt;&lt;/li&gt;&lt;li&gt;&lt;a href="https://www.gnu.org/software/emacs/" target="_blank"&gt;Emacs&lt;/a&gt;&lt;/li&gt;&lt;li&gt;&lt;a href="https://www.langchain.com/" target="_blank"&gt;LangChain&lt;/a&gt;&lt;/li&gt;&lt;li&gt;&lt;a href="https://www.langchain.com/langgraph" target="_blank"&gt;LangGraph&lt;/a&gt;&lt;/li&gt;&lt;li&gt;&lt;a href="https://www.crewai.com/" target="_blank"&gt;CrewAI&lt;/a&gt;&lt;/li&gt;&lt;/ul&gt;The intro and outro music is from &lt;a href="http://freemusicarchive.org/music/The_Freak_Fandango_Orchestra/Love_death_and_a_drunken_monkey/04_-_The_Hug" target="_blank"&gt;The Hug&lt;/a&gt; by &lt;a href="http://freemusicarchive.org/music/The_Freak_Fandango_Orchestra/" target="_blank"&gt;The Freak Fandango Orchestra&lt;/a&gt; / &lt;a href="http://creativecommons.org/licenses/by-sa/3.0/" target="_blank"&gt;CC BY-SA&lt;/a&gt;</description>

Data Engineering Podcast

Tobias Macey

The Future of Data Engineering: AI, LLMs, and Automation

FEB 26, 202559 MIN
Data Engineering Podcast

The Future of Data Engineering: AI, LLMs, and Automation

FEB 26, 202559 MIN

Description

Summary<br />In this episode of the Data Engineering Podcast Gleb Mezhanskiy, CEO and co-founder of DataFold, talks about the intersection of AI and data engineering. He discusses the challenges and opportunities of integrating AI into data engineering, particularly using large language models (LLMs) to enhance productivity and reduce manual toil. The conversation covers the potential of AI to transform data engineering tasks, such as text-to-SQL interfaces and creating semantic graphs to improve data accessibility, and explores practical applications of LLMs in automating code reviews, testing, and understanding data lineage.<br /><br /><br />Announcements<br /><ul><li>Hello and welcome to the Data Engineering Podcast, the show about modern data management</li><li>Data migrations are brutal. They drag on for months—sometimes years—burning through resources and crushing team morale. Datafold's AI-powered Migration Agent changes all that. Their unique combination of AI code translation and automated data validation has helped companies complete migrations up to 10 times faster than manual approaches. And they're so confident in their solution, they'll actually guarantee your timeline in writing. Ready to turn your year-long migration into weeks? Visit <a href="https://www.dataengineeringpodcast.com/datafold" target="_blank">dataengineeringpodcast.com/datafold</a> today for the details.&nbsp;</li><li>Your host is Tobias Macey and today I'm interviewing Gleb Mezhanskiy about&nbsp;</li></ul>Interview<br /><ul><li>Introduction</li><li>How did you get involved in the area of data management?</li><li>modern data stack is dead</li><li>where is AI in the data stack?</li><li>"buy our tool to ship AI"</li><li>opportunities for LLM in DE workflow</li></ul>Contact Info<br /><ul><li><a href="https://www.linkedin.com/in/glebmezh/" target="_blank">LinkedIn</a></li></ul>Parting Question<br /><ul><li>From your perspective, what is the biggest gap in the tooling or technology for data management today?</li></ul>Closing Announcements<br /><ul><li>Thank you for listening! Don't forget to check out our other shows. <a href="https://www.pythonpodcast.com" target="_blank">Podcast.__init__</a> covers the Python language, its community, and the innovative ways it is being used. The <a href="https://www.aiengineeringpodcast.com" target="_blank">AI Engineering Podcast</a> is your guide to the fast-moving world of building AI systems.</li><li>Visit the <a href="https://www.dataengineeringpodcast.com" target="_blank">site</a> to subscribe to the show, sign up for the mailing list, and read the show notes.</li><li>If you've learned something or tried out a project from the show then tell us about it! Email hosts@dataengineeringpodcast.com with your story.</li></ul>Links<br /><ul><li><a href="https://www.datafold.com/" target="_blank">Datafold</a></li><li><a href="https://github.com/features/copilot" target="_blank">Copilot</a></li><li><a href="https://www.cursor.com/" target="_blank">Cursor IDE</a></li><li><a href="https://www.ibm.com/think/topics/ai-agents" target="_blank">AI Agents</a></li><li><a href="https://datachat.ai/" target="_blank">DataChat</a><ul><li><a href="https://www.aiengineeringpodcast.com/datachat-llm-product-business-episode-31" target="_blank">AI Engineering Podcast Episode</a></li></ul></li><li><a href="https://www.ssp.sh/brain/metrics-layer/" target="_blank">Metrics Layer</a></li><li><a href="https://www.gnu.org/software/emacs/" target="_blank">Emacs</a></li><li><a href="https://www.langchain.com/" target="_blank">LangChain</a></li><li><a href="https://www.langchain.com/langgraph" target="_blank">LangGraph</a></li><li><a href="https://www.crewai.com/" target="_blank">CrewAI</a></li></ul>The intro and outro music is from <a href="http://freemusicarchive.org/music/The_Freak_Fandango_Orchestra/Love_death_and_a_drunken_monkey/04_-_The_Hug" target="_blank">The Hug</a> by <a href="http://freemusicarchive.org/music/The_Freak_Fandango_Orchestra/" target="_blank">The Freak Fandango Orchestra</a> / <a href="http://creativecommons.org/licenses/by-sa/3.0/" target="_blank">CC BY-SA</a>