Ai2 describes GPU time budgets that replaced its priority-based cluster scheduler

Ai2's AI Infrastructure team replaced its priority-based scheduler for GPU clusters with GPU time budgets, hierarchical fair-share allocation, and a time-slicing contract.

The team says the change moved debates over how much GPU time each research project deserves from case-by-case operational decisions into a transparent budgeting process.

The clusters range from 88 to 1024 GPUs across NVIDIA H100, B200, and B300 hardware, and serve about 150 internal researchers.