Ai2 replaces priority scheduler with GPU time budgets for cluster allocation

Ai2's AI Infrastructure team replaced its priority-based GPU cluster scheduler with a system using GPU time budgets, hierarchical fair-share allocation, and a time-slicing contract.

The team says the change turns decisions about how much GPU time each research project receives into a transparent administrative budgeting process.

Its clusters, which range from 88 to 1024 GPUs including H100, B200, and B300 units, serve about 150 researchers facing demand two to three times available capacity.