Intro topic: Asymmetric Returns News/Links: <ul><li>NanoChat by Andrej Karpathy<ul><li><a href="https://github.com/karpathy/nanochat">https://github.com/karpathy/nanochat</a></li></ul></li><li>Pydantic AI<ul><li><a href="https://www.marktechpost.com/2025/03/25/pydanticai-advancing-generative-ai-agent-development-through-intelligent-framework-design/">https://www.marktechpost.com/2025/03/25/pydanticai-advancing-generative-ai-agent-development-through-intelligent-framework-design/</a></li></ul></li><li>1000th Starlink this year<ul><li><a href="https://spaceflightnow.com/2025/05/16/live-coverage-spacex-plans-morning-launch-of-starlink-satellites-from-california/">https://spaceflightnow.com/2025/05/16/live-coverage-spacex-plans-morning-launch-of-starlink-satellites-from-california/</a></li></ul></li><li>ChatGPT Apps SDK<ul><li><a href="https://openai.com/index/introducing-apps-in-chatgpt/">https://openai.com/index/introducing-apps-in-chatgpt/ </a> </li></ul></li></ul>Book of the Show<ul><li>Patrick<ul><li>The Will of the Many by James Islington<ul><li><a href="https://amzn.to/43IfU8Q">https://amzn.to/43IfU8Q</a></li></ul></li></ul></li><li>Jason<ul><li>Interview with DHH (Founder of Ruby on Rails)<ul><li><a href="https://www.youtube.com/watch?v=vagyIcmIGOQ">https://www.youtube.com/watch?v=vagyIcmIGOQ </a> </li></ul></li></ul></li></ul> Patreon Plug <a href="https://www.patreon.com/programmingthrowdown?ty=h">https://www.patreon.com/programmingthrowdown?ty=h</a> Tool of the Show<ul><li>Patrick<ul><li>Factorio<ul><li><a href="https://www.factorio.com/">https://www.factorio.com/</a> </li></ul></li></ul></li><li>Jason<ul><li><a href="http://nip.io">nip.io</a> </li></ul></li></ul> Topic: Workflow Orchestrators <ul><li>Why<ul><li>Batch jobs (embarrassingly parallel)</li><li>Long-running tasks (e.g. transcoding video)</li><li>Checkpointing/resuming</li></ul></li><li>How<ul><li>Message Queues</li><li>Containerization</li><li>Worker Pools &amp; Autoscaling</li><li>History &amp; Backfill</li></ul></li><li>Steps to run workflows:<ul><li>Containerize the workflow definition and send to the cloud</li><li>Containerize all the individual tasks</li><li>Submit job(s)</li></ul></li><li>Examples<ul><li>Airflow<ul><li>Legacy but dominant</li></ul></li><li>Dagster<ul><li>Great UX for python developers</li></ul></li><li>Temporal: <a href="https://temporal.io/">https://temporal.io/</a><ul><li>The new hotness</li></ul></li><li>Ray<ul><li>Low-level but very powerful</li></ul></li><li>Kubeflow<ul><li>Designed for ML workflows, integrated dashboard</li></ul></li></ul></li></ul>

 <a href="https://www.patreon.com/programmingthrowdown" rel="payment" title="★ Support this podcast on Patreon ★">★ Support this podcast on Patreon ★</a>

<description>
 &lt;p&gt;&lt;strong&gt;Intro topic: Asymmetric Returns&lt;br&gt;&lt;/strong&gt;&lt;br&gt;&lt;/p&gt;&lt;p&gt;&lt;br&gt;&lt;/p&gt;&lt;p&gt;&lt;strong&gt;News/Links:&lt;br&gt;&lt;/strong&gt;&lt;br&gt;&lt;/p&gt;&lt;ul&gt;&lt;li&gt;NanoChat by Andrej Karpathy&lt;ul&gt;&lt;li&gt;&lt;a href="https://github.com/karpathy/nanochat"&gt;https://github.com/karpathy/nanochat&lt;/a&gt;&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;li&gt;Pydantic AI&lt;ul&gt;&lt;li&gt;&lt;a href="https://www.marktechpost.com/2025/03/25/pydanticai-advancing-generative-ai-agent-development-through-intelligent-framework-design/"&gt;https://www.marktechpost.com/2025/03/25/pydanticai-advancing-generative-ai-agent-development-through-intelligent-framework-design/&lt;/a&gt;&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;li&gt;1000th Starlink this year&lt;ul&gt;&lt;li&gt;&lt;a href="https://spaceflightnow.com/2025/05/16/live-coverage-spacex-plans-morning-launch-of-starlink-satellites-from-california/"&gt;https://spaceflightnow.com/2025/05/16/live-coverage-spacex-plans-morning-launch-of-starlink-satellites-from-california/&lt;/a&gt;&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;li&gt;ChatGPT Apps SDK&lt;ul&gt;&lt;li&gt;&lt;a href="https://openai.com/index/introducing-apps-in-chatgpt/"&gt;https://openai.com/index/introducing-apps-in-chatgpt/&lt;br&gt;&lt;/a&gt;&lt;br&gt;&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;/ul&gt;&lt;p&gt;&lt;strong&gt;Book of the Show&lt;/strong&gt;&lt;/p&gt;&lt;ul&gt;&lt;li&gt;Patrick&lt;ul&gt;&lt;li&gt;The Will of the Many by James Islington&lt;ul&gt;&lt;li&gt;&lt;a href="https://amzn.to/43IfU8Q"&gt;https://amzn.to/43IfU8Q&lt;/a&gt;&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;li&gt;Jason&lt;ul&gt;&lt;li&gt;Interview with DHH (Founder of Ruby on Rails)&lt;ul&gt;&lt;li&gt;&lt;a href="https://www.youtube.com/watch?v=vagyIcmIGOQ"&gt;https://www.youtube.com/watch?v=vagyIcmIGOQ&lt;br&gt;&lt;/a&gt;&lt;br&gt;&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;/ul&gt;&lt;p&gt;&lt;br&gt;&lt;/p&gt;&lt;p&gt;Patreon Plug &lt;a href="https://www.patreon.com/programmingthrowdown?ty=h"&gt;https://www.patreon.com/programmingthrowdown?ty=h&lt;/a&gt;&lt;/p&gt;&lt;p&gt;&lt;br&gt;&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Tool of the Show&lt;/strong&gt;&lt;/p&gt;&lt;ul&gt;&lt;li&gt;Patrick&lt;ul&gt;&lt;li&gt;Factorio&lt;ul&gt;&lt;li&gt;&lt;a href="https://www.factorio.com/"&gt;https://www.factorio.com/&lt;/a&gt; &lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;li&gt;Jason&lt;ul&gt;&lt;li&gt;&lt;a href="http://nip.io"&gt;nip.io&lt;/a&gt; &lt;p&gt;&lt;/p&gt;&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;/ul&gt;&lt;p&gt;&lt;br&gt;&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Topic: Workflow Orchestrators&lt;br&gt;&lt;/strong&gt;&lt;br&gt;&lt;/p&gt;&lt;ul&gt;&lt;li&gt;Why&lt;ul&gt;&lt;li&gt;Batch jobs (embarrassingly parallel)&lt;/li&gt;&lt;li&gt;Long-running tasks (e.g. transcoding video)&lt;/li&gt;&lt;li&gt;Checkpointing/resuming&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;li&gt;How&lt;ul&gt;&lt;li&gt;Message Queues&lt;/li&gt;&lt;li&gt;Containerization&lt;/li&gt;&lt;li&gt;Worker Pools &amp;amp; Autoscaling&lt;/li&gt;&lt;li&gt;History &amp;amp; Backfill&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;li&gt;Steps to run workflows:&lt;ul&gt;&lt;li&gt;Containerize the workflow definition and send to the cloud&lt;/li&gt;&lt;li&gt;Containerize all the individual tasks&lt;/li&gt;&lt;li&gt;Submit job(s)&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;li&gt;Examples&lt;ul&gt;&lt;li&gt;Airflow&lt;ul&gt;&lt;li&gt;Legacy but dominant&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;li&gt;Dagster&lt;ul&gt;&lt;li&gt;Great UX for python developers&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;li&gt;Temporal: &lt;a href="https://temporal.io/"&gt;https://temporal.io/&lt;/a&gt;&lt;ul&gt;&lt;li&gt;The new hotness&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;li&gt;Ray&lt;ul&gt;&lt;li&gt;Low-level but very powerful&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;li&gt;Kubeflow&lt;ul&gt;&lt;li&gt;Designed for ML workflows, integrated dashboard&lt;p&gt;&lt;/p&gt;&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;/ul&gt;&lt;/li&gt;&lt;/ul&gt;
&lt;strong&gt;
 &lt;a href="https://www.patreon.com/programmingthrowdown" rel="payment" title="★ Support this podcast on Patreon ★"&gt;★ Support this podcast on Patreon ★&lt;/a&gt;
&lt;/strong&gt;
 </description>

Programming Throwdown

185: Workflow Orchestrators

185: Workflow Orchestrators

Description