Tools · MarkTechPost ·
NVIDIA AI Releases Dynamo Snapshot: A CRIU-Based Fast Startup System for AI Inference on Kubernetes
NVIDIA introduced Dynamo Snapshot, a system that checkpoints and restores vLLM inference workers on Kubernetes using CRIU and cuda-checkpoint tools. It is designed to speed startup and recovery for AI inference workloads.