Perceptron AI releases EgoHome, a benchmark for hand actions in chore videos

AIPerceptron AI introduces EgoHome, an open benchmark for dense, sub-second egocentric video understanding, with over 750 segments under 500ms. Each clip carries human annotations for hand boxes, subtasks, hand actions, and hand captions, and the data, metrics, and judge prompts are all open.

Rohan Paul

@rohanpaul_ai

View on X

GPT-6 Astra came out on top in EgoHome, a new benchmark from Perceptron AI, that tests whether AI can follow what human hands do in chore videos, the skill robots need to learn from people.

AI can tell you someone is washing dishes, but not what their hands are doing, and robots need the second part.

This kind of benchmarks are so important because Robotics training now happen on large amounts of human video, and AI is used to label those videos automatically (“left hand picks up sponge, right hand turns tap”). If those labels are wrong, the robots learn wrong.

https://x.com/perceptroninc/status/2120192261665284274/video/1

Perceptron AI@perceptroninc

Introducing EgoHome: a new open benchmark for dense, sub-second egocentric understanding. Human-annotated household-chore video with 4 annotation types on every clip: hand boxes, subtasks, hand actions, hand captions. It features over 750 segments under 500ms. Data, metrics, and judge prompts are all open. 🧵

View quoted post on X

Source details

Rohan Paul · x.comPublished Nov 10, 4:57 PM ET · added here 5:22 PM ET

Original title: GPT-6 Astra came out on top in EgoHome, a new benchmark from Perceptron AI, that tests whether AI can follow what human hands do in chore...

Perceptron AI releases EgoHome, a benchmark for hand actions in chore videos

Topics