<p>Most AI infrastructure today is hitting a breaking point. Marc Austin, CEO of Hedgehog, reveals how open source networking and cloud-native solutions are revolutionizing how enterprises build and operate AI at scale. This episode addresses issues many building AI infrastructure today are facing — expensive proprietary systems, overwhelming complex network configurations, and ways to make on-prem AI infrastructure feel just like the public cloud.</p><p>We discuss how networking is the hidden bottleneck in scaling GPU clusters and the surprising physics and hardware innovations enabling higher throughput. Marc shares the journey of building Hedgehog, an open source, cloud-native platform designed for AI workloads that bridges the gap between complex hardware and seamless, user-friendly cloud experiences. Marc explains how Hedgehog&#39;s software abstracts and automates the networking complexity, making AI infrastructure accessible to enterprises without dedicated networking teams.</p><p>We break down the future of AI networks, from multi-cloud and hybrid environments to the rise of Neo Clouds and the open source movement transforming enterprise AI infrastructure. If you&#39;re a CTO, data scientist, or AI innovator, understanding these network innovations can be your moat. Listen to this episode to see how open source, cloud-native networking, and physical innovation are shaping the AI infrastructure of tomorrow.</p><p><br></p><p><strong>Podcast Links</strong></p><p>Watch: <a href="https://www.youtube.com/@alexa_griffith">⁠⁠⁠⁠https://www.youtube.com/@alexa_griffith⁠⁠⁠⁠</a></p><p>Read: <a href="https://alexasinput.substack.com/">⁠⁠⁠⁠⁠⁠https://alexasinput.substack.com/⁠⁠⁠⁠⁠⁠</a></p><p>Listen:<a href="https://creators.spotify.com/pod/profile/alexagriffith/">⁠⁠ https://creators.spotify.com/pod/profile/alexagriffith/⁠⁠</a></p><p><br></p><p>More: <a href="https://linktr.ee/alexagriffith">⁠⁠⁠⁠https://linktr.ee/alexagriffith⁠⁠⁠⁠</a></p><p><br></p><p>Website: <a href="https://alexagriffith.com/">⁠⁠⁠⁠https://alexagriffith.com/⁠⁠⁠⁠</a></p><p>LinkedIn: <a href="https://www.linkedin.com/in/alexa-griffith/">⁠⁠⁠⁠https://www.linkedin.com/in/alexa-griffith/⁠⁠⁠⁠</a></p><p><br></p><p><strong>Find out more about the guest at </strong></p><p><strong>LinkedIn:</strong>  <a href="https://www.linkedin.com/in/austinmarc/">https://www.linkedin.com/in/austinmarc/</a></p><p><strong>Website:</strong> <a href="https://hedgehog.cloud/">https://hedgehog.cloud/</a></p><p><strong>Github:</strong> <a href="https://github.com/githedgehog">https://github.com/githedgehog</a></p><p><br></p><p><strong>Chapters</strong></p><p>00:00 Rethinking AI Infrastructure</p><p>02:49 The Role of Networking in AI</p><p>05:54 Marc&#39;s Journey to Hedgehog</p><p>08:46 Lessons from Big Companies</p><p>11:38 Requirements for AI Networks</p><p>14:48 Advancements in AI Networking</p><p>17:33 Future Challenges in AI Infrastructure</p><p>20:46 Creating a Cloud Experience On-Prem</p><p>23:32 The Shift to Hybrid Multi-Cloud</p><p>28:10 Evolving AI Infrastructure and Efficiency</p><p>30:57 AI Workloads and Network Configurations</p><p>32:41 Zero Touch Lifecycle Management</p><p>35:12 Support for Hardware Devices</p><p>35:45 Networking Paradigms and Vendor Lock-in</p><p>38:42 The Rise of Neo Clouds</p><p>41:31 Demand for AI Infrastructure</p><p>43:57 Open Source and Cloud-Native Networking</p><p>47:27 Challenges of Building a Networking Startup</p><p>50:46 Proud Accomplishments at Hedgehog</p><p>52:41 Future Excitement in AI Inference</p><p><br></p>

Alexa's Input (AI)

Alexa Griffith

Inside the Future of AI Infrastructure with Marc Austin

FEB 6, 202645 MIN
Alexa's Input (AI)

Inside the Future of AI Infrastructure with Marc Austin

FEB 6, 202645 MIN

Description

<p>Most AI infrastructure today is hitting a breaking point. Marc Austin, CEO of Hedgehog, reveals how open source networking and cloud-native solutions are revolutionizing how enterprises build and operate AI at scale. This episode addresses issues many building AI infrastructure today are facing — expensive proprietary systems, overwhelming complex network configurations, and ways to make on-prem AI infrastructure feel just like the public cloud.</p><p>We discuss how networking is the hidden bottleneck in scaling GPU clusters and the surprising physics and hardware innovations enabling higher throughput. Marc shares the journey of building Hedgehog, an open source, cloud-native platform designed for AI workloads that bridges the gap between complex hardware and seamless, user-friendly cloud experiences. Marc explains how Hedgehog&#39;s software abstracts and automates the networking complexity, making AI infrastructure accessible to enterprises without dedicated networking teams.</p><p>We break down the future of AI networks, from multi-cloud and hybrid environments to the rise of Neo Clouds and the open source movement transforming enterprise AI infrastructure. If you&#39;re a CTO, data scientist, or AI innovator, understanding these network innovations can be your moat. Listen to this episode to see how open source, cloud-native networking, and physical innovation are shaping the AI infrastructure of tomorrow.</p><p><br></p><p><strong>Podcast Links</strong></p><p>Watch: <a href="https://www.youtube.com/@alexa_griffith">⁠⁠⁠⁠https://www.youtube.com/@alexa_griffith⁠⁠⁠⁠</a></p><p>Read: <a href="https://alexasinput.substack.com/">⁠⁠⁠⁠⁠⁠https://alexasinput.substack.com/⁠⁠⁠⁠⁠⁠</a></p><p>Listen:<a href="https://creators.spotify.com/pod/profile/alexagriffith/">⁠⁠ https://creators.spotify.com/pod/profile/alexagriffith/⁠⁠</a></p><p><br></p><p>More: <a href="https://linktr.ee/alexagriffith">⁠⁠⁠⁠https://linktr.ee/alexagriffith⁠⁠⁠⁠</a></p><p><br></p><p>Website: <a href="https://alexagriffith.com/">⁠⁠⁠⁠https://alexagriffith.com/⁠⁠⁠⁠</a></p><p>LinkedIn: <a href="https://www.linkedin.com/in/alexa-griffith/">⁠⁠⁠⁠https://www.linkedin.com/in/alexa-griffith/⁠⁠⁠⁠</a></p><p><br></p><p><strong>Find out more about the guest at </strong></p><p><strong>LinkedIn:</strong>  <a href="https://www.linkedin.com/in/austinmarc/">https://www.linkedin.com/in/austinmarc/</a></p><p><strong>Website:</strong> <a href="https://hedgehog.cloud/">https://hedgehog.cloud/</a></p><p><strong>Github:</strong> <a href="https://github.com/githedgehog">https://github.com/githedgehog</a></p><p><br></p><p><strong>Chapters</strong></p><p>00:00 Rethinking AI Infrastructure</p><p>02:49 The Role of Networking in AI</p><p>05:54 Marc&#39;s Journey to Hedgehog</p><p>08:46 Lessons from Big Companies</p><p>11:38 Requirements for AI Networks</p><p>14:48 Advancements in AI Networking</p><p>17:33 Future Challenges in AI Infrastructure</p><p>20:46 Creating a Cloud Experience On-Prem</p><p>23:32 The Shift to Hybrid Multi-Cloud</p><p>28:10 Evolving AI Infrastructure and Efficiency</p><p>30:57 AI Workloads and Network Configurations</p><p>32:41 Zero Touch Lifecycle Management</p><p>35:12 Support for Hardware Devices</p><p>35:45 Networking Paradigms and Vendor Lock-in</p><p>38:42 The Rise of Neo Clouds</p><p>41:31 Demand for AI Infrastructure</p><p>43:57 Open Source and Cloud-Native Networking</p><p>47:27 Challenges of Building a Networking Startup</p><p>50:46 Proud Accomplishments at Hedgehog</p><p>52:41 Future Excitement in AI Inference</p><p><br></p>