NVIDIA introduces memory-enforced GPU sharing in Kubernetes with CUDA 13.4
Overview
NVIDIA's technical blog describes memory-enforced GPU sharing in Kubernetes using CUDA 13.4, which lets platform teams run multiple AI workloads on a single GPU. The post says that dedicating a whole GPU to each workload can leave capacity idle.
It notes that NVIDIA GPUs already support sharing through multi-instance GPU (MIG), which splits a GPU into hardware-isolated instances. The available text does not give details on how the new mechanism enforces memory limits.
Written by AI from the articles below · updated Oct 27, 5:40 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
- NVIDIA Technical BlogOfficialMemory-enforced GPU sharing in Kubernetes with NVIDIA CUDA 13.4
AINVIDIA's technical blog describes memory-enforced GPU sharing in Kubernetes using CUDA 13.4, letting platform teams run multiple AI workloads on a single GPU. The excerpt says that giving each workload a whole device can leave capacity idle, and that NVIDIA GPUs already support sharing approaches such as multi-instance GPU (MIG), which splits a GPU into hardware-isolated instances. The provided text does not give further details on the new mechanism.
Heat Trend
- Current comparable heat
- 7
- Peak comparable heat
- 10Oct 27, 6:00 PM ET
- Change in past 24 hours
- –
The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.