Oxide and Friends
Oxide Computer Company
Recent Episodes
We hit a new (and disturbing!) failure mode recently when a production rack that had been up for several months saw every (!) compute sled's service processor become simultaneously unresponsive. Bryan and Adam were joined by the members of the Oxide team who debugged the vexing issue -- and reached its surprising root cause.
In addition to Bryan Cantrill and Adam Leventhal, we were joined by Oxide colleagues, Cliff Biffle, Matt Keeter, and Will Chandler.
Previously, on Oxide and Friends:
- OxF s05e03 – Holistic Engineering with Robert Mustacchi
- OxF s04e14 – Rebooting a datacenter: A decade later
- OxF s01e26 – The Pragmatism of Hubris
- OxF s05e20 – Debugger-Driven Development (omdb)
- OxF s05e07 – Transparency in Hardware/Software Interfaces
- OxF s05e31 – Futurelock
- OxF s05e33 – A Grown-up ZFS Data Corruption Bug
Some of the topics we hit on, in the order that we hit them:
- hubris #2304: STM32H7 Ethernet driver stops yielding CPU after many packets
- gist — Summarizing the Hubris side of investigations
- Matt's blog: Hunting a spooky ethernet driver bug
If we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
Hey hey! We recently tripped over a ZFS data corruption bug–introduced over 18 years ago! Bryan and Adam discuss with members of the Oxide team as well as Matt Ahrens, the co-inventor of ZFS.
In addition to Bryan Cantrill and Adam Leventhal, speakers included Alan Hanson, Matt Keeter, Andy Fiddaman, James MacMahon, and special guest, Matt Ahrens.
Previously, on Oxide and Friends:
Some of the topics we hit on, in the order that we hit them:
- ZFS fsync can trigger ZIL transaction reordering and data corruption
- RFD 177: Implementation of Data Storage
- the "fix" that introduced data corruption
- PRs needed!
If we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
Oxide founders, Bryan and Steve, as well as Oxide investor, Seth Winterroth, were joined by Liz Zalman and Jerry Neumann, authors of the book Founder vs. Investor, discussing the collaboration and conflict in company formation. Adam was also present.
In addition to Bryan Cantrill and Adam Leventhal, our guests included Liz Zalman, Jerry Neumann, Seth Winterroth (Oxide investor), and Steve Tuck (Oxide founder / CEO).
Some of the topics we hit on, in the order that we hit them:
- Founder vs. Investor
- Topic
- [@M:SS](link into recording) Leventhal's Conundrum
- PRs needed!
If we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
We're big users of async Rust at Oxide, and recently we found (another) very odd and hard to debug pathology related to async Rust that we dubbed "Futurelock". Oxide engineers who diagnosed the problem join Bryan and Adam to describe Futurelock and discuss methods to identify and avoid it.
In addition to Bryan Cantrill and Adam Leventhal, speakers included our Oxide colleagues Dave Pacheco, John Gallagher, Rain Paharia. Sean Klein, and Eliza Weisman.
Previously, on Oxide and Friends:
Some of the topics we hit on, in the order that we hit them:
- Oxide RFD 609: Futurelock
- PRs needed!
If we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
Revisiting an annual tradition--Books in the Box! Bryan, Adam, and the Oxide Friends share book recommendations (and--sometimes--anti-recommendations). Take a listen if you're looking for your next read.
In addition to Bryan Cantrill and Adam Leventhal, we were joined by some guests noted below:
Previously, on Oxide and Friends:
- OxF s05e06 - A Half‑Century of Silicon Valley with Randy Shoup
- OxF s05e26 - Technological Revolutions with Jerry Neumann
- OxF s04e03 - Fork in the Road for Terraform
- OxF s01e16 - The Books in the Box
- OxF s02e18 - Books in the Box Redux
- OxF s03e22 - Books in the Box III
- OxF s04e28 - Books in the Box IV
Other Notes:
- Princeton Review: Happiest Students
- UMass Dining Named Best Campus Food by The Princeton Review
- CHM Oral Histories
- Night Rider (and K.I.T.T.)
From Bryan and Adam (and others)
- The Mouse Driver Chronicles
- Fumbling the Future
- Slingshot
- Chip War
- Technological Revolutions and Financial Capital @bcantrill (economics book recommendation)
- Snow Crash (another Neal Stephenson book)
- The Big Short
- Reinventing The Wheel
- Eccentric Orbits (recommended by listener)
- Language Machines Cultural AI and the End of Remainder Humanism (recommended by listener)
- Molly White's **review ** of Read Write Own
- Careless People
- NOT A RECOMMENDATION If Anyone Builds It, Everyone Dies (If you are Molly White, please destroy this for us!)
- Surreal Numbers by Knuth (recommended by listeners)
From Oliver Herman
From Tom Lyon
From Dan McDonald
If we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!