Banger paper from Google on using agent swarms to fix Google's TPU compiler.
The team used swarms of AI agents to find and fix silent compiler bugs, and the framework has resolved over 142 of them so far.
They find silent miscompilations are the most dangerous. The compiler raises no error, but numbers drift, or buffers get corrupted, which can ruin a large training run or degrade live serving.
The team combines fuzzing on synthetic and real production graphs with checks that run alongside the existing autotuner. A bisection pipeline narrows a failure in a full workload down to one operation inside a fused kernel.
The agents generate stress tests, reproduce failures, and write fixes.
The team steered them away from easy crash bugs and toward silent data corruption, and 103 more findings are under review.
They also report that reviewer effort grew faster than the complexity of the fixes, and agent patches needed adversarial pre-filtering before humans looked at them.
https://arxiv.org/abs/2611.00624
Chat with Paper: https://academy.dair.ai/papers/xla-from-the-trenches-correctness-on-tpu-workloads-at-scale-2611.00624