Skip to content
Trending storyDeveloping

BAAI attributes frontier agent failures on research tasks to retrieval drift and search polarization

1 article1 sourcesince Oct 20Last article 1h ago ·

Overview

AISummary of 1 article

BAAI reports that its fine-grained error analysis of frontier agent trajectories finds two main failure patterns.

On Deep Research tasks, Retrieval Drift accounts for 32% to 41% of failures: agents reach the right research area but fix on cited baseline papers or adjacent works instead of meeting every constraint. On Wide Research tasks, the failures split by model. Claude-Opus-4.6 shows 85.3% Unconstrained Expansion, collecting many unverified papers at the cost of precision, while Seed-2.0-Pro shows 33.3% Premature Termination, stopping after retrieving only a few candidates. BAAI concludes that agents lack stateful evidence tracking and a precise sense of scientific concept boundaries.

Written by AI from the articles below · updated Oct 20, 9:56 AM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 20
  1. BAAIOfficial
    Frontier agents fail research tasks through retrieval drift and polarized search

    AIBAAI's fine-grained error analysis of frontier agent trajectories finds Deep Research failures dominated by Retrieval Drift at 32%–41%, where agents latch onto cited baseline papers instead of resolving all constraints. On Wide Research tasks, Claude-Opus-4.6 shows 85.3% Unconstrained Expansion, over-collecting unverified papers, while Seed-2.0-Pro shows 33.3% Premature Termination after retrieving only a few candidates. BAAI concludes that agents lack stateful evidence tracking and the ability to delineate precise scientific concept boundaries.

    Image from @BAAIBeijing's post

Heat Trend

Not enough continuous observations to show a trend yet.