vLLM cuts Elastic EP scaling downtime to under two seconds on DeepSeek V4 Pro

vLLM's Elastic EP scaling now reduces serving downtime to 0.82 seconds when scaling DeepSeek V4 Pro from 16 to 20 GPUs. The source attributes this to background preparation of joining workers, NIXL EP's in-place rank changes, and preserved CUDA graphs on existing workers. The authors say the same benchmark took 1.96 seconds to scale back from 20 to 16 GPUs.