Skip to content
View original post on X: Rohan Paul
Published
62/100

UCLA and Northeastern study finds 18% of AI agent output tokens are removable waste

AIA UCLA and Northeastern University paper estimates that about 18% of AI agent output tokens across 6 frontier models and 4 benchmarks were removable waste. Using an LLM judge to mark spans and rerunning agents after deletion, the authors report pruning cut 41% of waste from Kimi-K3's reasoning on SWE-bench Verified with success at 89.5% versus 89.0%.
Rohan PaulVerified on X
@rohanpaul_ai
View on X

New UCLA+ Northeastern University paper finds that about 18% of AI agent output tokens are removable waste, and cutting it barely hurts task success.

Agent bills are usually measured as total tokens. That number can't tell you which tokens did useful work and which just repeated a policy, refetched a file, or went down a dead end.

They route agent calls through a proxy and have an LLM judge mark spans that can go without losing useful work. Then they delete those spans and rerun the agent to check nothing breaks.

Across 6 frontier models and 4 benchmarks, about 18% of output tokens were waste. Pruning repetition and filler from Kimi-K3's reasoning removed 41% of it on SWE-bench Verified, and success stayed at 89.5% versus 89.0%.

To cut agent costs, find where your task and harness create waste instead of just capping tokens.

Source details

Rohan Paul · x.comPublished · added here

Original title: New UCLA+ Northeastern University paper finds that about 18% of AI agent output tokens are removable waste, and cutting it barely hurts t...