Data World generates data-analysis RL environments, reports gains on three benchmarks
Overview
Data World, a new engine, generates data-analysis environments from scratch by first defining the mechanisms behind each dataset, then producing files, tasks, and grading rubrics.
According to a paper summarized by Elvis Saravia (@omarsar0), training Qwen3.6-35B-A3B with reinforcement learning on 2,135 of these tasks, without distilled trajectories, adds 20.9 points on DABstep-Hard, 14.28 on DAComp, and 12.13 on JobBench.
The paper also reports that ten frontier models compute correct numbers more often than they draw correct conclusions from them.
Written by AI from the articles below · updated Oct 18, 6:05 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
elvis@omarsar0XData World scales RL data environments, adding 20.9 points on DABstep-HardAIData World, a new engine, generates data-analysis environments from scratch by first defining the mechanisms behind each dataset, then producing files, tasks, and grading rubrics. Training Qwen3.6-35B-A3B with RL on 2,135 of these tasks, without distilled trajectories, adds 20.9 points on DABstep-Hard, 14.28 on DAComp, and 12.13 on JobBench. The paper also finds that ten frontier models compute correct numbers more often than they draw correct conclusions from them.

Heat Trend
Not enough continuous observations to show a trend yet.