Meta study finds RL post-training can shrink agents' task coverage at 128 attempts
Overview
A Meta paper reports that reinforcement learning post-training raises agents' first-attempt accuracy but can reduce how many tasks they solve at all when given up to 128 tries.
Across 14 base and post-trained model pairs on three agentic benchmarks, the authors found a positive "Sharpening Tax" in 36 of 42 cases, meaning coverage shrank. The source is a social media post by Rohan Paul summarizing the paper; the paper itself was not reviewed for this overview.
Written by AI from the articles below · updated Oct 29, 1:25 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
Rohan Paul@rohanpaul_aiXMeta paper finds RL post-training can shrink agents' solution coverageAIA Meta paper finds reinforcement learning post-training improves agents' first-attempt accuracy but can reduce how many tasks they ever solve given up to 128 tries. Across 14 base and post-trained model pairs on three agentic benchmarks, the authors report a positive Sharpening Tax in 36 of 42 cases, meaning coverage shrank.

Heat Trend
Not enough continuous observations to show a trend yet.