Llama 3 and Phi-3-mini are up and running on phones, Raspberry Pis, and we give them a go. Plus Google kills the vibe, and Meta opens up Horizon OS.Sponsored By:<ul><li><a href="https://jupitersignal.memberful.com/checkout?plan=53334&coupon=darthjarjar" rel="nofollow">Coder QA</a>: <a href="https://jupitersignal.memberful.com/checkout?plan=53334&coupon=darthjarjar" rel="nofollow">Take $1 a month off your membership for a year, and contribute to our show directly!</a> Promo Code: darthjarjar</li></ul><a href="https://jupitersignal.memberful.com/checkout?plan=53334" rel="payment">Support Coder Radio</a>Links:<ul><li><a href="https://strike.me/" title="💥 Gets Sats Quick and Easy with Strike" rel="nofollow">💥 Gets Sats Quick and Easy with Strike</a> &mdash; Strike is a lightning-powered app that lets you quickly and cheaply grab sats in over 36 countries.</li><li><a href="https://www.fountain.fm/" title="📻 Boost with Fountain.FM" rel="nofollow">📻 Boost with Fountain.FM</a> &mdash; Fountain 1.0 has a new UI, upgrades, and super simple Strike integration for easy Boosts.</li><li><a href="https://blog.google/inside-google/company-announcements/building-ai-future-april-2024/" title="Building for our AI future" rel="nofollow">Building for our AI future</a> &mdash; But ultimately we are a workplace and our policies and expectations are clear: this is a business, and not a place to act in a way that disrupts coworkers or makes them feel unsafe, to attempt to use the company as a personal platform, or to fight over disruptive issues or debate politics. </li><li><a href="https://www.axios.com/2024/04/19/google-fires-employees-protest-israel" title="Google, after protester firings, now looks just like every other company" rel="nofollow">Google, after protester firings, now looks just like every other company</a> &mdash; Google's firing of 28 protesting employees Wednesday sends the clearest signal yet that the tech giant — whose founders pledged it was "not a conventional company" — has become just that.</li><li><a href="https://www.amazon.com/Plex-Google-Thinks-Works-Shapes/dp/1416596585" title="In the Plex: How Google Thinks, Works, and Shapes Our Lives: Levy, Steven: 9781416596585: Amazon.com: Books" rel="nofollow">In the Plex: How Google Thinks, Works, and Shapes Our Lives: Levy, Steven: 9781416596585: Amazon.com: Books</a> &mdash; Written with full cooperation from top management, including cofounders Sergey Brin and Larry Page, this is the inside story behind Google, the most successful and most admired technology company of our time, told by one of our best technology writers.</li><li><a href="https://www.itprotoday.com/artificial-intelligence/meta-debuts-llama-3-latest-ai-model-powering-chatbots" title="Meta Debuts Llama 3, Latest AI Model for Powering Chatbots" rel="nofollow">Meta Debuts Llama 3, Latest AI Model for Powering Chatbots</a> &mdash; Llama 3, unveiled Thursday, is an upgrade from an AI model that Meta released last summer. Chief Product Officer Chris Cox said that model, Llama 2, has been downloaded 170 billion times. Llama 2 was billed as open source, though its license included some restrictions such as requiring companies with more than 700 million users to ask for permission to use it.</li><li><a href="https://www.datacenterdynamics.com/en/news/metas-mark-zuckerberg-says-energy-constraints-are-holding-back-ai-data-center-buildout/" title="Meta's Mark Zuckerberg says energy constraints are holding back AI data center buildout - DCD" rel="nofollow">Meta's Mark Zuckerberg says energy constraints are holding back AI data center buildout - DCD</a> &mdash; "Now I think that's getting less, and you're seeing a bunch of companies thinking 'wow we should really just invest a lot of money in building out these things.' I think that will go [on] for some period of time."</li><li><a href="https://privatellm.app/en" title="Private LLM: Secure Offline & Local AI Chatbot for iOS & macOS" rel="nofollow">Private LLM: Secure Offline & Local AI Chatbot for iOS & macOS</a> &mdash; Private LLM is a local AI chatbot for iOS and macOS that works offline</li><li><a href="https://www.theverge.com/2024/4/23/24137534/microsoft-phi-3-launch-small-ai-language-model" title="Microsoft launches Phi-3, its smallest AI model yet - The Verge" rel="nofollow">Microsoft launches Phi-3, its smallest AI model yet - The Verge</a> &mdash; Phi-3 learned from ‘bedtime stories’ created by other LLMs.</li><li><a href="https://arxiv.org/abs/2404.14219" title="Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone" rel="nofollow">Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone</a></li><li><a href="https://twitter.com/dylan522p/status/1782461647497400324" title="Dylan Patel on X:" rel="nofollow">Dylan Patel on X:</a> &mdash; Synthetic data pipelines are massive improvements over internet data
Flywheel only continues with big models too when these techniques are applied</li><li><a href="https://twitter.com/arankomatsuzaki/status/1782622124248617230" title="Aran Komatsuzaki on X: "A few caveats about Phi-3:"" rel="nofollow">Aran Komatsuzaki on X: "A few caveats about Phi-3:"</a> &mdash; Phi-3-medium performs well on TriviaQA but noticeably underperforms rel. to GPT-3.5. We can guess that Phi-3 recipe doesn't magically make it understand more random factoids. It's more focused on valuable knowledges (e.g. STEM), which makes sense.</li><li><a href="https://www.cnet.com/tech/computing/meta-opens-up-its-vr-os-to-third-party-headsets/" title="Meta Expands Its Mixed Reality Beyond the Quest Headsets - CNET" rel="nofollow">Meta Expands Its Mixed Reality Beyond the Quest Headsets - CNET</a> &mdash; Meta opened the Quest Horizon OS to others, and now VR headsets from Asus, Lenovo and even an Xbox variant are on the way.</li><li><a href="https://www.meta.com/blog/quest/meta-horizon-os-open-hardware-ecosystem-asus-republic-gamers-lenovo-xbox/" title="A New Era for Mixed Reality | Meta Quest Blog | Meta Store" rel="nofollow">A New Era for Mixed Reality | Meta Quest Blog | Meta Store</a></li></ul>

<description>Llama 3 and Phi-3-mini are up and running on phones, Raspberry Pis, and we give them a go. Plus Google kills the vibe, and Meta opens up Horizon OS. 
</description>

Llama 3 and Phi-3-mini are up and running on phones, Raspberry Pis, and we give them a go. Plus Google kills the vibe, and Meta opens up Horizon OS.

567: The year of Small Models 

We delve into the top 3 open-source revenue streams, expose the pitfalls, and discuss what could be done quickly to improve the situation.Sponsored By:<ul><li><a href="https://jupitersignal.memberful.com/checkout?plan=53334&coupon=darthjarjar" rel="nofollow">Coder QA</a>: <a href="https://jupitersignal.memberful.com/checkout?plan=53334&coupon=darthjarjar" rel="nofollow">Take $1 a month off your membership for a year, and contribute to our show directly!</a> Promo Code: darthjarjar</li></ul><a href="https://jupitersignal.memberful.com/checkout?plan=53334" rel="payment">Support Coder Radio</a>Links:<ul><li><a href="https://strike.me/" title="💥 Gets Sats Quick and Easy with Strike" rel="nofollow">💥 Gets Sats Quick and Easy with Strike</a> &mdash; Strike is a lightning-powered app that lets you quickly and cheaply grab sats in over 36 countries.</li><li><a href="https://www.fountain.fm/" title="📻 Boost with Fountain.FM" rel="nofollow">📻 Boost with Fountain.FM</a> &mdash; Fountain 1.0 has a new UI, upgrades, and super simple Strike integration for easy Boosts.</li><li><a href="https://www.meetup.com/system76-community/events/299957317/" title="System76 and Jupiter Broadcasting Epic Parking Lot BBQ, Sat, Apr 27, 2024, 4:30 PM | Meetup" rel="nofollow">System76 and Jupiter Broadcasting Epic Parking Lot BBQ, Sat, Apr 27, 2024, 4:30 PM | Meetup</a> &mdash; Join Jupiter Broadcasting and System76 in the parking lot of Bellingham Technical College after the LinuxFest Northwest conference! Let's eat, drink and be nerdy!</li><li><a href="https://www.theregister.com/2024/04/09/san_francisco_muni_floppy_disks/" title="San Francisco's light rail to upgrade from floppy disks " rel="nofollow">San Francisco's light rail to upgrade from floppy disks </a> &mdash; The agency noted that its system was installed in 1998, when floppies were still in common use</li><li><a href="https://dominickm.com/1662-2/" title="Open Source's Funding Fiasco - dominickm.com" rel="nofollow">Open Source's Funding Fiasco - dominickm.com</a> &mdash; I’ve been thinking a lot about how we as a community and industry can make sure open-source projects keep getting the love they deserve. It’s no secret that the traditional funding model of donations and sponsorships is more than a little shaky.</li><li><a href="https://arstechnica.com/security/2024/04/what-we-know-about-the-xz-utils-backdoor-that-almost-infected-the-world/" title="What we know about the xz Utils backdoor that almost infected the world" rel="nofollow">What we know about the xz Utils backdoor that almost infected the world</a> &mdash; Researchers have spent the weekend gathering clues. Here's what we know so far.</li><li><a href="https://github.com/localstack" title="LocalStack" rel="nofollow">LocalStack</a> &mdash; LocalStack is a cloud development platform that facilitates building/testing of cloud and serverless applications on your local machine. At its core, it features a service emulator that runs in a single container on your laptop or in your CI environment. </li><li><a href="https://www.netflix.com/title/81024821" title="Watch 3 Body Problem | Netflix Official Site" rel="nofollow">Watch 3 Body Problem | Netflix Official Site</a> &mdash; Across continents and decades, five brilliant friends make earth-shattering discoveries as the laws of science unravel and an existential threat emerges.</li></ul>

<description>We delve into the top 3 open-source revenue streams, expose the pitfalls, and discuss what could be done quickly to improve the situation. 
</description>

We delve into the top 3 open-source revenue streams, expose the pitfalls, and discuss what could be done quickly to improve the situation.

566: FOSS Feed & Care

Why does Meta give away Llma for free? What&#39;s in it for them? 

Plus, our thoughts on the data showing the trades are starting to see a boom, and new coding jobs are declining.Sponsored By:<ul><li><a href="https://jupitersignal.memberful.com/checkout?plan=53334&coupon=darthjarjar" rel="nofollow">Coder QA</a>: <a href="https://jupitersignal.memberful.com/checkout?plan=53334&coupon=darthjarjar" rel="nofollow">Take $1 a month off your membership for a year, and contribute to our show directly!</a> Promo Code: darthjarjar</li></ul><a href="https://jupitersignal.memberful.com/checkout?plan=53334" rel="payment">Support Coder Radio</a>Links:<ul><li><a href="https://strike.me/" title="💥 Gets Sats Quick and Easy with Strike" rel="nofollow">💥 Gets Sats Quick and Easy with Strike</a> &mdash; Strike is a lightning-powered app that lets you quickly and cheaply grab sats in over 36 countries.</li><li><a href="https://www.fountain.fm/" title="📻 Boost with Fountain.FM" rel="nofollow">📻 Boost with Fountain.FM</a> &mdash; Fountain 1.0 has a new UI, upgrades, and super simple Strike integration for easy Boosts.</li><li><a href="https://www.meetup.com/system76-community/events/299957317/" title="System76 and Jupiter Broadcasting Epic Parking Lot BBQ, Sat, Apr 27, 2024, 4:30 PM | Meetup" rel="nofollow">System76 and Jupiter Broadcasting Epic Parking Lot BBQ, Sat, Apr 27, 2024, 4:30 PM | Meetup</a> &mdash; Join Jupiter Broadcasting and System76 in the parking lot of Bellingham Technical College after the LinuxFest Northwest conference! Let's eat, drink and be nerdy!</li><li><a href="https://www.theverge.com/2024/4/9/24124168/google-vids-video-ai-workspace-app" title="Google Vids is the latest AI-powered app in Workspace - The Verge" rel="nofollow">Google Vids is the latest AI-powered app in Workspace - The Verge</a> &mdash; Google’s latest Workspace app reflects the way people talk at work now — and maybe signals the end of the slide deck’s supremacy.</li><li><a href="https://9to5google.com/2024/04/09/google-workspace-cloud-next-2024/" title="Cloud Next 2024: Gmail voice input, Gemini for Google Chat, more" rel="nofollow">Cloud Next 2024: Gmail voice input, Gemini for Google Chat, more</a> &mdash; Google is updating Help me write in mobile Gmail with voice prompting and input that lets you “send emails easily when you’re on the go.” Meanwhile, an “instant polish” feature will “convert rough notes to a complete email with one-click.” Google shared today that “70% of enterprise users who use Help Me Write in Docs or Gmail end up using Gemini’s suggestions.”</li><li><a href="https://www.theverge.com/2024/4/8/24116587/microsoft-macbook-air-surface-arm-qualcomm-snapdragon-x-elite" title="Microsoft is confident Windows on Arm could finally beat Apple - The Verge" rel="nofollow">Microsoft is confident Windows on Arm could finally beat Apple - The Verge</a> &mdash; After years of issues, the upcoming Qualcomm chips might be a big moment for Windows on Arm.</li><li><a href="https://techcrunch.com/2024/04/09/google-announces-axion-its-first-custom-arm-based-data-center-processor/" title="Google announces Axion, its first custom Arm-based data center processor | TechCrunch" rel="nofollow">Google announces Axion, its first custom Arm-based data center processor | TechCrunch</a> &mdash; Google did not provide any documentation to back these claims up and, like us, you’d probably like to know more about these chips. We asked a lot of questions, but Google politely declined to provide any additional information. No availability dates, no pricing, no additional technical data. Those “benchmark” results? The company wouldn’t even say which X86 instance it was comparing Axion to.</li><li><a href="https://www.theinformation.com/articles/meta-platforms-to-launch-small-versions-of-llama-3-next-week" title="Meta Platforms to Launch Small Versions of Llama 3 Next Week — The Information" rel="nofollow">Meta Platforms to Launch Small Versions of Llama 3 Next Week — The Information</a></li><li><a href="https://www.youtube.com/watch?v=9k3ShxE2VOw" title="TV Host Mike Rowe weighs in on Gen Z gravitating toward trade jobs - YouTube" rel="nofollow">TV Host Mike Rowe weighs in on Gen Z gravitating toward trade jobs - YouTube</a></li></ul>

<description>Why does Meta give away Llma for free? What's in it for them? 
Plus, our thoughts on the data showing the trades are starting to see a boom, and new coding jobs are declining. 
</description>

Why does Meta give away Llma for free? What's in it for them? 

Plus, our thoughts on the data showing the trades are starting to see a boom, and new coding jobs are declining.

565: The Great Llama

Microsoft wins the foot-in-mouth award this week, and Google gets the Rust religion - but Mike is skeptical.Sponsored By:<ul><li><a href="https://jupitersignal.memberful.com/checkout?plan=53334&coupon=jarjar" rel="nofollow">Coder QA</a>: <a href="https://jupitersignal.memberful.com/checkout?plan=53334&coupon=jarjar" rel="nofollow">Take $2 a month off for the lifetime of your membership and contribute to our show directly</a> Promo Code: jarjar</li></ul><a href="https://jupitersignal.memberful.com/checkout?plan=53334" rel="payment">Support Coder Radio</a>Links:<ul><li><a href="https://strike.me/" title="💥 Gets Sats Quick and Easy with Strike" rel="nofollow">💥 Gets Sats Quick and Easy with Strike</a> &mdash; Strike is a lightning-powered app that lets you quickly and cheaply grab sats in over 36 countries.</li><li><a href="https://www.fountain.fm/" title="📻 Boost with Fountain.FM" rel="nofollow">📻 Boost with Fountain.FM</a> &mdash; Fountain 1.0 has a new UI, upgrades, and super simple Strike integration for easy Boosts.</li><li><a href="https://www.dailymail.co.uk/sciencetech/article-13263453/battery-tossed-nasa-iss-florida-home.html" title="Piece of 5,800lb battery pallet tossed from NASA's ISS crashes through Florida home - and nearly kills homeowner's so" rel="nofollow">Piece of 5,800lb battery pallet tossed from NASA's ISS crashes through Florida home - and nearly kills homeowner's so</a> &mdash; A piece of metal came crashing through a home in Florida that is believed to be from a 5,800-pound battery pallet discarded by the International Space Station (ISS).</li><li><a href="https://gizmodo.com/amazon-reportedly-ditches-just-walk-out-grocery-stores-1851381116" title="Amazon Ditches 'Just Walk Out' Checkouts at Its Grocery Stores" rel="nofollow">Amazon Ditches 'Just Walk Out' Checkouts at Its Grocery Stores</a> &mdash; “Though it seemed completely automated, Just Walk Out relied on more than 1,000 people in India watching and labeling videos to ensure accurate checkouts”</li><li><a href="https://twitter.com/FFmpeg/status/1775178803129602500" title="FFmpeg on X" rel="nofollow">FFmpeg on X</a> &mdash; The xz fiasco has shown how a dependence on unpaid volunteers can cause major problems. Trillion dollar corporations expect free and urgent support from volunteers.</li><li><a href="https://www.theregister.com/2024/03/31/rust_google_c/" title="Rust developers at Google twice as productive as C++ devs" rel="nofollow">Rust developers at Google twice as productive as C++ devs</a> &mdash; Speaking at the Rust Nation UK Conference in London this week, Lars Bergstrom, director of engineering at Google, who works on Android Platform Tools & Libraries, described the web titan's experience migrating projects written in Go or C++ to the Rust programming language.</li><li><a href="https://www.inverse.com/tech/spatial-persona-apple-vision-pro" title="Spatial Personas Make Apple Vision Pro a Less Isolating Experience" rel="nofollow">Spatial Personas Make Apple Vision Pro a Less Isolating Experience</a> &mdash; Up to five people can watch movies and TV shows, play AR games, and collaborate on work together even when they’re across the planet.</li><li><a href="https://twitter.com/raywongy/status/1775156667950252348" title="Two Persona Video Demo on X" rel="nofollow">Two Persona Video Demo on X</a> &mdash; Here's a video of two Persona (plus the one looking at them) provided by Apple. This wasn't recorded from my demo yesterday. It's just a demo to show what spatial Persona on Apple Vision Pro looks like</li><li><a href="https://tailscale.com/events-webinars/devops-days-raleigh-happy-hour" title="Tailscale happy hour in Raleigh" rel="nofollow">Tailscale happy hour in Raleigh</a> &mdash; You are invited to join Tailscale for a happy hour event following DevOpsDays Raleigh. Enjoy drinks and light apps on us.</li></ul>

<description>Microsoft wins the foot-in-mouth award this week, and Google gets the Rust religion - but Mike is skeptical. 
</description>

Microsoft wins the foot-in-mouth award this week, and Google gets the Rust religion - but Mike is skeptical.

564: Re-Re-Rewrite it in Rust

Mike makes the case for just going vanilla, a look at Google Carbon, and then we address the expensive elephant in the room.Sponsored By:<ul><li><a href="https://jupitersignal.memberful.com/checkout?plan=53334&coupon=jarjar" rel="nofollow">Coder QA</a>: <a href="https://jupitersignal.memberful.com/checkout?plan=53334&coupon=jarjar" rel="nofollow">Take $2 a month off for the lifetime of your membership and contribute to our show directly</a> Promo Code: jarjar</li></ul><a href="https://jupitersignal.memberful.com/checkout?plan=53334" rel="payment">Support Coder Radio</a>Links:<ul><li><a href="https://strike.me/" title="💥 Gets Sats Quick and Easy with Strike" rel="nofollow">💥 Gets Sats Quick and Easy with Strike</a> &mdash; Strike is a lightning-powered app that lets you quickly and cheaply grab sats in over 36 countries.</li><li><a href="https://www.fountain.fm/" title="📻 Boost with Fountain.FM" rel="nofollow">📻 Boost with Fountain.FM</a> &mdash; Fountain 1.0 has a new UI, upgrades, and super simple Strike integration for easy Boosts.</li><li><a href="https://www.macrumors.com/2024/03/26/apple-announces-wwdc-2024/" title="Apple Announces WWDC 2024 Event for June 10 to 14" rel="nofollow">Apple Announces WWDC 2024 Event for June 10 to 14</a> &mdash; Apple today announced that its 35th annual Worldwide Developers Conference is set to take place from Monday, June 10 to Friday, June 14</li><li><a href="https://9to5mac.com/2023/11/16/apple-rcs-coming-to-iphone/" title="Apple announces that RCS support is coming to iPhone" rel="nofollow">Apple announces that RCS support is coming to iPhone</a> &mdash; The feature will launch via a software update “later next year” and bring a wide range of iMessage-style features to messaging between iPhone and Android users.</li><li><a href="https://helix-editor.com/" title="Helix" rel="nofollow">Helix</a> &mdash; Multiple cursors as a core editing primitive, inspired by Kakoune. Commands manipulate selections which allows concurrent code editing. </li><li><a href="https://github.com/rails/importmap-rails" title="importmap-rails: Use ESM with importmap to manage modern JavaScript in Rails without transpiling or bundling." rel="nofollow">importmap-rails: Use ESM with importmap to manage modern JavaScript in Rails without transpiling or bundling.</a> &mdash; With this approach you'll ship many small JavaScript files instead of one big JavaScript file. </li><li><a href="https://lmstudio.ai/" title="LM Studio" rel="nofollow">LM Studio</a> &mdash; Discover, download, and run local LLMs</li><li><a href="https://github.com/carbon-language/carbon-lang" title="Carbon Language's main repository" rel="nofollow">Carbon Language's main repository</a> &mdash; An experimental successor to C++</li><li><a href="https://www.documentcloud.org/documents/24445015-barbara-fried-sbf-sentencing-submission" title="Barbara Fried SBF sentencing submission - DocumentCloud" rel="nofollow">Barbara Fried SBF sentencing submission - DocumentCloud</a> &mdash; I am Sam Bankman-Fried's mother.</li><li><a href="https://storage.courtlistener.com/recap/gov.uscourts.nysd.590940/gov.uscourts.nysd.590940.407.3_1.pdf" title="Dad's Letter" rel="nofollow">Dad's Letter</a> &mdash; 2¶ØVØ^~_ ØKVØV_Ø£ªb¹·ÎbØ£Ðb©·ØiØ}\ØV`Ø£c«·cÎc©Y^c ØV`</li><li><a href="https://www.audiobookshelf.org/" title="audiobookshelf" rel="nofollow">audiobookshelf</a> &mdash; Self-hosted audiobook and podcast server</li><li><a href="https://apps.nextcloud.com/apps/gpoddersync" title="GPodder Sync - Nextcloud" rel="nofollow">GPodder Sync - Nextcloud</a> &mdash; Expose GPodder API to sync podcast consumer apps like AntennaPod</li></ul>

<description>Mike makes the case for just going vanilla, a look at Google Carbon, and then we address the expensive elephant in the room. 
</description>

Mike makes the case for just going vanilla, a look at Google Carbon, and then we address the expensive elephant in the room.

563: Mike’s No Good Very Bad Rails Update

A weekly talk show taking a pragmatic look at the art and business of Software Development and the world of technology.


Coder Radio

Details

Recent Episodes