Cutting Serverless Latency by 50% with Autonomous Optimization - Nikhil Gopinath, Sedai

Most serverless functions are unoptimized resulting in unnecessary latency and/or cost. Serverless functions can be optimized for performance, cost or a balanced strategy without human effort using autonomous systems. Nikhil Gopinath, VP ML at Sedai, outlines these challenges and the autonomous solution, and also reviews key results from fabric which cut latency by 48% using an autonomous system. Key moments: 01:53: Optimization Challenges for Serverless 03:36: Memory Settings 09:36: Optimize for Performance & Cost 11:18: The default for most Lambdas 12:20: The best of both worlds 13:06: Real time use cases 15:47: Batch & backend use cases 17:51: Challenges for backend optimization 20:32: Under the hood of autonomous system 22:24: How fabric reduced latency by 50% 25:15: fabric's challenges for managing serverless 27:02: fabric application architecture 27:59: fabric uses 10,000 services 30:11: Scaling up & down autonomously in production 32:03: Optimizing for latency vs cost 32:45: Matching supply to demand 34:43: Will autonomous cause downtime? 36:08: Does duration always go down when you inc To learn more about Sedai visit https://bit.ly/3e3Cqlv #autonomouscloud #lambda #sre #devops #aws #serverless #fabric #sedai #autocon22