Skip to content
View original post on X: Rohan Paul
Published
38/100

Memories.ai launches Memories Upload for hand-level robot training video

AIMemories.ai launches Memories Upload, which captions first-person footage with time-stamped descriptions of each hand so the archive can be searched by action. The company says it pays people worldwide to record their hands at work, then cleans, labels, and sells the footage to robotics labs.
Rohan PaulVerified on X
@rohanpaul_ai
View on X

Searching video by what the hands are doing is one of the most useful ideas in robotics data right now.

from a camera on a worker’s head to a JSON file in a training run.

Memories Upload, from http://Memories.ai, gives every moment of first person footage a time-stamped caption for each hand, so the archive can be queried by action.

Robots learn hand skills by watching humans, so http://Memories.ai pays people worldwide to record their hands at work, then cleans, labels and sells that footage to labs building robots.

Shawn Shen@shawnshenjx
Today we launch #MemoriesUpload. Robots need internet-scale first-person video of how people get things done. Collecting this at high quality takes hardware, model and infra working together. That's what we've spent over a year building. And already, 3 of the top 5 frontier robotics labs are training models with the data.
View quoted post on X
Source details

Rohan Paul · x.comPublished · added here

Original title: Searching video by what the hands are doing is one of the most useful ideas in robotics data right now.