Skip to content
View original post on X: elvis
Published
62/100

Google Cloud AI Research proposes object-oriented agent harnesses that raise benchmark scores

AIGoogle Cloud AI Research and UIUC introduce OO-Harness, which evolves a hierarchy of specialized agent harness classes from execution records. On AutomationBench, the score rises from 61.6% to 77.4% with the same Gemini 3.5 Flash executor, and the paper reports gains on Workspace-Bench and Toolathlon-GYM as well.
elvisVerified on X
@omarsar0
View on X

Build specialized harnesses, folks.

This is a banger paper from Google Cloud AI Research on self-evolving agent harnesses.

(bookmark it)

They introduce OO-Harness, which raises AutomationBench from 61.6% to 77.4% with the same Gemini 3.5 Flash executor.

It also beats Meta-Harness on all three benchmarks they test.

More details below.

Instead of evolving one global harness for every task, an evolution agent builds a class hierarchy of specialized harnesses from execution records.

The design has three parts.

Subclasses inherit the base harness and override only the methods a task cluster needs
Design lessons record which changes helped and which ones failed
A router reads the task and the base run, then picks a subclass or keeps the base result

On Workspace-Bench, the score goes from 25.5% to 39.5%, and on Toolathlon-GYM strict pass goes from 31.2% to 37.5%. Spending extra inference on best-of-K sampling or self-refinement does not reliably help.

Inheritance also improves results. On Workspace-Bench, harnesses built as subclasses score 4.96 points higher than the same evolved code copied into flat classes.

https://arxiv.org/abs/2610.28380

Chat with Paper: https://academy.dair.ai/papers/object-oriented-harness-evolving-agent-harnesses-through-object-oriented-design-2610.28380

Source details

elvis · x.comPublished · added here

Original title: Build specialized harnesses, folks.