Skip to content
View original post on X: Philipp SchmidOfficial· Pick61/100AI score61/100

Google Research's Harness² lets agents improve their own harness on unseen tasks

AISummary

Google Research released Harness², a framework in which an agent improves the harness around a frozen model. Its editor, composer, and reflector agents draft, merge, and log edits from baseline trajectories. Gemini 3.5 Flash gains 8.4 points on WorkBuddy-Bench and 7.5 on JobBench, and dropping skills costs 5.3 points.

AIWhy it matters

The paper shows agents editing their own harness on unseen tasks, with reported gains per benchmark and an ablation on skills, useful for judging the method's source of improvement.

Post on XView on X
Philipp SchmidVerified on X
@_philschmid

Can Agents improve their own harness on unseen tasks? The @GoogleResearch team released Harness², a framework that allows improve an harness around a frozen model.

How it works:
1️⃣ Agent runs the base harness on each task to record a baseline trajectory
2️⃣ Editor agent inspects the trajectory, drafts 2 candidate edits (SI, Skills, hooks,….), and runs both.
3️⃣ Composer agent diffs the new trajectory against the baseline, merges edits that fixed failures (within a cap), and runs the final harness.
4️⃣ Reflector agent logs verified lessons into file and saves the winning components to a library for future tasks to pull on demand.

Results:
- 💡 Gemini 3.5 Flash +8.4 on WorkBuddy-Bench and +7.5 on JobBench.
- 🛠️ Skills and scripts drive ~50% of edits; dropping skills costs 5.3 pts.
- 📚 Gemini 3.5 Flash improves on all 3 benchmarks when editing its own harness.

Paper: https://arxiv.org/abs/2610.14224
Code: https://github.com/google-research/harness2

Source: Philipp Schmid · x.comPublished