Skip to content
Trending storyDeveloping

Meta study finds RL post-training can shrink agents' task coverage at 128 attempts

1 article1 sourcesince Oct 29Last article 1h ago ·

Overview

AISummary of 1 article

A Meta paper reports that reinforcement learning post-training raises agents' first-attempt accuracy but can reduce how many tasks they solve at all when given up to 128 tries.

Across 14 base and post-trained model pairs on three agentic benchmarks, the authors found a positive "Sharpening Tax" in 36 of 42 cases, meaning coverage shrank. The source is a social media post by Rohan Paul summarizing the paper; the paper itself was not reviewed for this overview.

Written by AI from the articles below · updated Oct 29, 1:25 PM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 29
  1. Rohan PaulX
    Meta paper finds RL post-training can shrink agents' solution coverage

    AIA Meta paper finds reinforcement learning post-training improves agents' first-attempt accuracy but can reduce how many tasks they ever solve given up to 128 tries. Across 14 base and post-trained model pairs on three agentic benchmarks, the authors report a positive Sharpening Tax in 36 of 42 cases, meaning coverage shrank.

    Image from @rohanpaul_ai's post

Heat Trend

Not enough continuous observations to show a trend yet.