The End of Cold Starts: Autonomous Concurrency - Nikhil Gopinath, Sedai

AUG 12, 202224 MIN

Description

Cold starts are the #1 performance problem for Lambda users. Autonomous concurrency provides a solution with fewer cold starts than warmup strategies, and lower cost than provisioned concurrency. Sedai VP of ML, Nikhil Gopinath explains the underlying challenge of cold starts and presents the autonomous concurrency solution and compares it to traditional solutions. Key moments: 00:49: Understanding concurrency and cold starts 04:20: Cold starts by the numbers 05:56: Concurrent requests and cold starts 08:02: Provisioned concurrency 09:41: Introducing autonomous concurrency 11:53: Difference from warmup plugins 14:39: Difference from provisioned concurrency 16:25: Comparing Cost of Different Approaches 18:00: How Autonomous Concurrency Works 19:19: How Autonomous Concurrency Looks 20:14: Component Details 21:32: Q&A: Working alongside other optimizations 22:17: Q&A: Interference with other extensions? To learn more about Sedai visit https://bit.ly/3e3Cqlv #coldstarts #lambda #autonomouscloud #sre #devops #aws #serverless #sedai #autocon22