Skip to content
View original post on X: elvisX· 46/100AI score46/100

Data World scales RL data environments, adding 20.9 points on DABstep-Hard

AISummary

Data World, a new engine, generates data-analysis environments from scratch by first defining the mechanisms behind each dataset, then producing files, tasks, and grading rubrics.

Training Qwen3.6-35B-A3B with RL on 2,135 of these tasks, without distilled trajectories, adds 20.9 points on DABstep-Hard, 14.28 on DAComp, and 12.13 on JobBench.

The paper also finds that ten frontier models compute correct numbers more often than they draw correct conclusions from them.

Post on XView on X
elvisVerified on X
@omarsar0

Nice paper on scaling data environments from scratch.

They built an engine that creates data-analysis environments from scratch. They apply RL, which adds 20.9 points on DABstep-Hard.

Data World first writes down the mechanisms that generate a dataset, then produces the files, tasks, and grading rubrics. Because the generating process is known, open-ended findings can be checked, and independent audits confirm each answer can be recovered from the files.

Training Qwen3.6-35B-A3B with RL on 2,135 of these tasks, with no distilled trajectories, also adds 14.28 points on DAComp and 12.13 on JobBench.

The benchmark finding is just as useful. Ten frontier models compute the right numbers more often than they draw the right conclusion from them.

https://arxiv.org/abs/2610.21656

Chat with Paper: https://academy.dair.ai/papers/data-world-scaling-data-environments-from-scratch-2610.21656

Source: elvis · x.comPublished · added here