Google and HKU propose VeriCUA to verify computer-use agent task completion
Overview
Google and the University of Hong Kong propose VeriCUA, a framework that checks whether a computer-use agent actually finished a task.
According to the paper, the agent's own claim of success does not count as proof. VeriCUA explores the app to build a requirement checklist, then runs screen or code checks, such as reading saved files, until each item is settled.
On the ScienceBoard benchmark, the paper reports a 5.4% false-positive rate for VeriCUA, compared with 24.8% for a vision-language model judge and 21.7% for a generated script verifier. The figures come from the paper as reported by Rohan Paul on X.
Written by AI from the articles below · updated Nov 2, 10:01 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
Rohan Paul@rohanpaul_aiXGoogle and HKU's VeriCUA verifies computer-use agents by checking saved stateAIA Google and University of Hong Kong paper, VeriCUA, argues that a computer-use agent's own claim of task completion should not count as proof. The framework explores the app to build a requirement checklist, then checks GUI or code evidence such as saved files and app data. On ScienceBoard it reports a 5.4% false-positive rate, against 24.8% for a VLM judge and 21.7% for a generated script verifier.

Heat Trend
Not enough continuous observations to show a trend yet.