Skip to content
Trending storyDeveloping

Modal reports off-policy GRPO corrections stabilize training on SWE-bench Pro V2

1 article1 sourcesince Oct 13Last article 1h ago ·

Overview

AISummary of 1 article

Modal says it stabilized GRPO training on mixed samplers by adding masked importance sampling, score centering, and top-p sampling with mask replay to standard GRPO. Modal reports that training on the mixed samplers became stable as evaluated on SWE-bench Pro V2.

The only source is a post on Modal's X account. The post gives no figures for the stability measurement and does not describe a comparison against standard GRPO results.

Written by AI from the articles below · updated Oct 13, 2:41 PM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 13
  1. ModalOfficial
    Modal describes off-policy GRPO corrections that stabilize SWE-bench Pro V2 training

    AIModal says it stabilized GRPO training on mixed samplers by adding masked importance sampling, score centering, and top-p sampling with mask replay. It reports that the approach yields stable training as evaluated on SWE-bench Pro V2.

    Image from @modal's post

Heat trend

Not enough continuous observations to show a trend yet.