# CUGA harness lifts open-weight model's AppWorld task completion to 81% versus 30–47% for rivals

> Original title: Same Model, Different Harness: CUGA, Hermes, and Deep Agents — When to Pick CUGA?

- Source: Hugging Face Blog
- Published: 2026-11-03T15:57:39.000Z
- Bad Influence: https://badinfluence.news/items/ggrffd50j3mp1wgaluiap4n5o
- Original: https://huggingface.co/blog/ibm-research/cuga-harness

## Summary

Hugging Face compared CUGA, Hermes and Deep Agents on AppWorld using the same GLM-5.3-flash model and 90 tasks, with task completion at 81.1% for CUGA, 46.7% for Hermes and 30.0% for Deep Agents. Scenarios where all three variants passed were 66.7% for CUGA, 26.7% for Hermes and 6.7% for Deep Agents. The authors note the setups were not identical and the sample covers one benchmark.