Links 
<a href="https://www.linkedin.com/in/jahuang/" rel="nofollow">James on LinkedIn</a> 
<a href="https://www.linkedin.com/in/dominucco/" rel="nofollow">Mike on LinkedIn</a> 
<a href="https://dominickm.com" rel="nofollow">Mike&#39;s Blog</a> 
<a href="https://discord.com/invite/k8e7gKUpEp" rel="nofollow">Show on Discord</a>

<a href="https://go.alice.dev/data-migration-offer-hands-on" rel="nofollow">Alice Promo</a>

<ol>
<li>AI on Red Hat Enterprise Linux (RHEL)</li>
</ol>

Trust and Stability: RHEL provides the mission-critical foundation needed for workloads where security and reliability cannot be compromised.

Predictive vs. Generative: Acknowledging the hype of GenAI while maintaining support for traditional machine learning algorithms.

Determinism: The challenge of bringing consistency and security to emerging AI technologies in production environments.

<ol>
<li>Rama-Llama &amp; Containerization</li>
</ol>

Developer Simplicity: Rama-Llama helps developers run local LLMs easily without being &quot;locked in&quot; to specific engines; it supports Podman, Docker, and various inference engines like Llama.cpp and Whisper.cpp.

Production Path: The tool is designed to &quot;fade away&quot; after helping package the model and stack into a container that can be deployed directly to Kubernetes.

Behind the Firewall: Addressing the needs of industries (like aircraft maintenance) that require AI to stay strictly on-premises.

<ol>
<li>Enterprise AI Infrastructure</li>
</ol>

Red Hat AI: A commercial product offering tools for model customization, including pre-training, fine-tuning, and RAG (Retrieval-Augmented Generation).

Inference Engines: James highlights the difference between Llama.cpp (for smaller/edge hardware) and vLLM, which has become the enterprise standard for multi-GPU data center inferencing.

<description>Links
James on LinkedIn (https://www.linkedin.com/in/jahuang/)
Mike on LinkedIn (https://www.linkedin.com/in/dominucco/)
Mike's Blog (https://dominickm.com)
Show on Discord (https://discord.com/invite/k8e7gKUpEp)
Alice Promo (https://go.alice.dev/data-migration-offer-hands-on)
AI on Red Hat Enterprise Linux (RHEL)
Trust and Stability: RHEL provides the mission-critical foundation needed for workloads where security and reliability cannot be compromised.
Predictive vs. Generative: Acknowledging the hype of GenAI while maintaining support for traditional machine learning algorithms.
Determinism: The challenge of bringing consistency and security to emerging AI technologies in production environments.
Rama-Llama &amp; Containerization
Developer Simplicity: Rama-Llama helps developers run local LLMs easily without being "locked in" to specific engines; it supports Podman, Docker, and various inference engines like Llama.cpp and Whisper.cpp.
Production Path: The tool is designed to "fade away" after helping package the model and stack into a container that can be deployed directly to Kubernetes.
Behind the Firewall: Addressing the needs of industries (like aircraft maintenance) that require AI to stay strictly on-premises.
Enterprise AI Infrastructure
Red Hat AI: A commercial product offering tools for model customization, including pre-training, fine-tuning, and RAG (Retrieval-Augmented Generation).
Inference Engines: James highlights the difference between Llama.cpp (for smaller/edge hardware) and vLLM, which has become the enterprise standard for multi-GPU data center inferencing. 
</description>


In this episode of the Coder Radio (Coder.show) network, Michael Dominick sits down with James Huang, Senior Product Manager of AI and High Performance Computing at Red Hat, to discuss the intersection of enterprise-grade Linux and the rapidly evolving world of artificial intelligence.



636: Red Hat's James Huang

<a href="https://www.tabnine.com/" rel="nofollow">Tabnine</a> 
<a href="https://www.linkedin.com/in/eranyahav/" rel="nofollow">Eran on LinkedIn</a>

<a href="https://alice.dev/alice-snowflake/" rel="nofollow">Alice for Snowflake</a>

<a href="https://x.com/dominucco" rel="nofollow">Mike on X</a> 
<a href="https://x.com/coderradioshow" rel="nofollow">Coder on X</a>

<a href="https://discord.gg/k8e7gKUpEp" rel="nofollow">Show Discord</a>

<a href="https://alice.dev" rel="nofollow">Alice &amp; Custom Dev</a>

<description>Tabnine (https://www.tabnine.com/)
Eran on LinkedIn (https://www.linkedin.com/in/eranyahav/)
Alice for Snowflake (https://alice.dev/alice-snowflake/)
Mike on X (https://x.com/dominucco)
Coder on X (https://x.com/coderradioshow)
Show Discord (https://discord.gg/k8e7gKUpEp)
Alice &amp; Custom Dev (https://alice.dev) 
</description>

Mike sits down with Eran Yahav of Tabine to talk enterprise coding agents and AI assisted coding. 

635: Tabnine's Eran Yahav

<a href="https://www.linkedin.com/in/franckpachot/" rel="nofollow">Frank on LinkedIn</a> 
<a href="https://www.mongodb.com/" rel="nofollow">MongoDB</a>

<a href="https://alice.dev/alice-snowflake/" rel="nofollow">Alice for Snowflake</a>

<a href="https://x.com/dominucco" rel="nofollow">Mike on X</a> 
<a href="https://x.com/coderradioshow" rel="nofollow">Coder on X</a>

<a href="https://discord.gg/k8e7gKUpEp" rel="nofollow">Show Discord</a>

<a href="https://alice.dev" rel="nofollow">Alice &amp; Custom Dev</a>

<a href="https://dominickm.com/omakhub-review/" rel="nofollow">Mike&#39;s Recent Omakub Blog Post</a>

<description>Frank on LinkedIn (https://www.linkedin.com/in/franckpachot/)
MongoDB (https://www.mongodb.com/)
Alice for Snowflake (https://alice.dev/alice-snowflake/)
Mike on X (https://x.com/dominucco)
Coder on X (https://x.com/coderradioshow)
Show Discord (https://discord.gg/k8e7gKUpEp)
Alice &amp; Custom Dev (https://alice.dev)
Mike's Recent Omakub Blog Post (https://dominickm.com/omakhub-review/) 
</description>

Mike sits down to get schoole on NOSQL and Mongo DB!

634: MongoDB's Frank Pachot

<ul>
<li><a href="https://www.linkedin.com/in/joemasilotti/" rel="nofollow">Joe on LinkedIn</a></li>
<li><a href="https://masilotti.com/about/" rel="nofollow">Joe&#39;s Blog</a></li>
<li><a href="https://x.com/joemasilotti" rel="nofollow">Joe on X</a></li>
</ul>

<a href="https://alice.dev/alice-snowflake/" rel="nofollow">Alice for Snowflake</a>

<a href="https://x.com/dominucco" rel="nofollow">Mike on X</a> 
<a href="https://bsky.app/profile/dominucco.bsky.social" rel="nofollow">Mike on BlueSky</a> 
<a href="https://x.com/coderradioshow" rel="nofollow">Coder on X</a>

<a href="https://discord.gg/k8e7gKUpEp" rel="nofollow">Show Discord</a>

<a href="https://alice.dev" rel="nofollow">Alice &amp; Custom Dev</a>

<a href="https://dominickm.com/omakhub-review/" rel="nofollow">Mike&#39;s Recent Omakub Blog Post</a>

<description>Joe on LinkedIn (https://www.linkedin.com/in/joemasilotti/)
Joe's Blog (https://masilotti.com/about/)
Joe on X (https://x.com/joemasilotti)
Alice for Snowflake (https://alice.dev/alice-snowflake/)
Mike on X (https://x.com/dominucco)
Mike on BlueSky (https://bsky.app/profile/dominucco.bsky.social)
Coder on X (https://x.com/coderradioshow)
Show Discord (https://discord.gg/k8e7gKUpEp)
Alice &amp; Custom Dev (https://alice.dev)
Mike's Recent Omakub Blog Post (https://dominickm.com/omakhub-review/) 
</description>

Mike sits down with Joe Masilotti to discuss mobile development with extremely exciting Hotwire Native. 

633: Hotwire Native with Joe Masilotti

<a href="https://www.linkedin.com/in/merrill-lutsky/" rel="nofollow">Merrill on LinkedIn</a> 
<a href="https://graphite.com/" rel="nofollow">Graphite</a>

<a href="https://alice.dev/alice-snowflake/" rel="nofollow">Alice for Snowflake</a>

<a href="https://x.com/dominucco" rel="nofollow">Mike on X</a> 
<a href="https://bsky.app/profile/dominucco.bsky.social" rel="nofollow">Mike on BlueSky</a> 
<a href="https://x.com/coderradioshow" rel="nofollow">Coder on X</a>

<a href="https://discord.gg/k8e7gKUpEp" rel="nofollow">Show Discord</a>

<a href="https://alice.dev" rel="nofollow">Alice &amp; Custom Dev</a>

<a href="https://dominickm.com/omakhub-review/" rel="nofollow">Mike&#39;s Recent Omakub Blog Post</a>

<description>Merrill on LinkedIn (https://www.linkedin.com/in/merrill-lutsky/)
Graphite (https://graphite.com/)
Alice for Snowflake (https://alice.dev/alice-snowflake/)
Mike on X (https://x.com/dominucco)
Mike on BlueSky (https://bsky.app/profile/dominucco.bsky.social)
Coder on X (https://x.com/coderradioshow)
Show Discord (https://discord.gg/k8e7gKUpEp)
Alice &amp; Custom Dev (https://alice.dev)
Mike's Recent Omakub Blog Post (https://dominickm.com/omakhub-review/) 
</description>

Mike sits down with Merrill Lutsky the CEO and Founder of Graphite to talk AI powered code-review, the state of software development and more!


632: Graphite's Merrill Lutsky 

A weekly talk show taking a pragmatic look at the art and business of Software Development and the world of technology.


Coder Radio

Details

Recent Episodes