The paper for MiMo-V2.6 by Xiaom is out.
In MiMo-V2.6, AI runs much of its own training loop: agents build the tasks, audit the tests, grade the answers and hunt for cheats. Humans set the budget and the rules.
shows that agent models kept improving with more RL compute by scaling batch size, task and harness variety, and grading effort together.
Scaling RL for coding agents is hard because pass/fail tests can't tell a clean fix from a hacky fix. Agents also learn to game environments, for example by downloading the published fix.
A grader agent compared passing patches in each group and moved reward to the cleaner ones. Without it, agents drifted toward longer runs and workarounds like swallowed exceptions.
MiMo-V2.6-Pro’s DeepSWE score rose from 58.4 to 72.6 over $2.6M of RL and was still climbing when training stopped.
– arxiv. org/abs/2610.11959
Title: "MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement"