Cedana

Cedana (YC S23) brings hyperscaler and frontier-lab orchestration capabilities for AI workflows. Our core capability is live migration for CPUs and GPUs workloads. This increases cost savings up to 80%, accelerates time to first token 2-10x, and enables stateful reliability of training jobs even through catastrophic GPU failures. We've integrated our solution into K8s, and support Kueue and Slurm for training distributed jobs, and Kserve for serving inference.  

OpenAI, Meta and Microsoft have flavors of these capabilities internally and we’re bringing them to everyone. 

Our vision is to transform cloud compute into a real-time, arbitraged commodity. 

https://www.cedana.ai