Skip to content
Trending storyDeveloping

Paper fits scaling laws for agentic RL data across tasks, environments and trajectories

1 article1 sourcesince Oct 20Last article 2h ago ·

Overview

AISummary of 1 article

A paper on agentic reinforcement learning fits scaling laws along three data axes: tasks, environments and trajectories, according to Elvis Saravia, who describes it on X. The authors report that across model sizes, model families, domains, and both PPO and GRPO, the scaling exponents rank environments above tasks, and tasks above trajectories.

The authors also report that allocating a training budget with their recipe gives up to 1.7x compute efficiency compared with the common practice of generating more trajectories.

Written by AI from the articles below · updated Oct 20, 9:18 AM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 20
  1. elvisXPick
    Paper fits scaling laws for agentic RL data across tasks, environments and trajectories

    AIA paper on agentic reinforcement learning fits scaling laws along three data axes: tasks, environments and trajectories. Across model sizes and both PPO and GRPO, the exponents rank environments above tasks, and tasks above trajectories. The authors report that allocating budget with their recipe yields up to 1.7x compute efficiency over generating more trajectories.

    Image from @omarsar0's post

Heat Trend

Not enough continuous observations to show a trend yet.