Skip to content
View original post on X: BAAIOfficial
Published
40/100

Frontier agents fail research tasks through retrieval drift and polarized search

AIBAAI's fine-grained error analysis of frontier agent trajectories finds Deep Research failures dominated by Retrieval Drift at 32%–41%, where agents latch onto cited baseline papers instead of resolving all constraints. On Wide Research tasks, Claude-Opus-4.6 shows 85.3% Unconstrained Expansion, over-collecting unverified papers, while Seed-2.0-Pro shows 33.3% Premature Termination after retrieving only a few candidates.
BAAIVerified on XOfficial
@BAAIBeijing
View on X

Part of a thread · earlier post

Fine-grained error attribution on frontier agent trajectories reveals two systematic bottlenecks:

• Deep Research Failures: Dominated by Retrieval Drift (32%–41%)—agents reach the relevant research neighborhood but latch onto cited baseline papers or adjacent works instead of resolving all constraints.

• Wide Research Polarization: Claude-Opus-4.6 exhibits 85.3% Unconstrained Expansion (over-collecting unverified papers at the cost of precision), whereas Seed-2.0-Pro suffers 33.3% Premature Termination (quitting after retrieving only a few candidates).

Agents systematically lack stateful evidence tracking and the capability to delineate precise scientific concept boundaries.

Source details

BAAI · x.comPublished · added here

Original title: Fine-grained error attribution on frontier agent trajectories reveals two systematic bottlenecks: