CUGA harness lifts open-weight model's AppWorld task completion to 81% versus 30–47% for rivals
AIHugging Face compared CUGA, Hermes and Deep Agents on AppWorld using the same GLM-5.3-flash model and 90 tasks, with task completion at 81.1% for CUGA, 46.7% for Hermes and 30.0% for Deep Agents. Scenarios where all three variants passed were 66.7% for CUGA, 26.7% for Hermes and 6.7% for Deep Agents.
Source details
Hugging Face Blog · huggingface.coPublished · added here
Original title: Same Model, Different Harness: CUGA, Hermes, and Deep Agents — When to Pick CUGA?