VicOne tests show manipulated inputs can make robots ignore safety limits
Overview
VicOne LAB R7 tested whether untrusted inputs can change robot behavior, and reports that several robots responded to manipulation.
A robot dog followed instructions written on a poster, and a simulated hospital-service robot was altered by crafted inaudible audio. In a bounty test, an injected ROS 2/DDS message made a robot move under a setting organizers expected to keep it still.
IEEE Spectrum, which reports on the tests, argues that safety reviews should check how deliberate manipulation, not only accidental faults, can affect the inputs that safety functions rely on.
Written by AI from the articles below · updated Oct 27, 1:39 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
- IEEE Spectrum · AINewsRobot safety functions can fail when manipulated inputs mislead them
AIVicOne LAB R7 tested how untrusted inputs can change robot behavior, including a robot dog that followed text on a poster and a hospital-service robot simulation altered by crafted inaudible audio. In one bounty test, an injected ROS 2/DDS message made a robot move under a setting organizers expected to keep it still. The article argues that safety reviews should test how deliberate manipulation, not only accidental faults, can affect the inputs safety functions rely on.
Heat Trend
- Current comparable heat
- 6
- Peak comparable heat
- 10Oct 27, 2:00 PM ET
- Change in past 24 hours
- –
The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.