Skip to content
Trending storyDeveloping

Data World generates data-analysis RL environments, reports gains on three benchmarks

1 article1 sourcesince Oct 18Last article 1h ago ·

Overview

AISummary of 1 article

Data World, a new engine, generates data-analysis environments from scratch by first defining the mechanisms behind each dataset, then producing files, tasks, and grading rubrics.

According to a paper summarized by Elvis Saravia (@omarsar0), training Qwen3.6-35B-A3B with reinforcement learning on 2,135 of these tasks, without distilled trajectories, adds 20.9 points on DABstep-Hard, 14.28 on DAComp, and 12.13 on JobBench.

The paper also reports that ten frontier models compute correct numbers more often than they draw correct conclusions from them.

Written by AI from the articles below · updated Oct 18, 6:05 PM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 18
  1. elvisX
    Data World scales RL data environments, adding 20.9 points on DABstep-Hard

    AIData World, a new engine, generates data-analysis environments from scratch by first defining the mechanisms behind each dataset, then producing files, tasks, and grading rubrics. Training Qwen3.6-35B-A3B with RL on 2,135 of these tasks, without distilled trajectories, adds 20.9 points on DABstep-Hard, 14.28 on DAComp, and 12.13 on JobBench. The paper also finds that ten frontier models compute correct numbers more often than they draw correct conclusions from them.

    Image from @omarsar0's post

Heat Trend

Not enough continuous observations to show a trend yet.