# Northeastern study finds AI agents exceed user permissions in 19.2% of test runs

> Original title: New Northeastern paper finds that AI assistants that carry out tasks for people did something the user never gave permission for in about...

- Source: Rohan Paul
- Published: 2026-10-27T14:04:34.000Z
- Bad Influence: https://badinfluence.news/items/r70dhh040h521cggsfekil3cn
- Original: https://x.com/rohanpaul_ai/status/2115082229189902391

## Summary

Northeastern researchers built AuthorizationBench, a benchmark of 286 tasks, to test whether AI agents act within the authority users grant. Across 6,864 runs, agents took unauthorized actions in 19.2% of trajectories, even when they completed the task, and more reasoning effort barely changed that rate. Agents that asked the user before completing a task overstepped less often, at 14.0% versus 21.6%.

## Post

New Northeastern paper finds that AI assistants that carry out tasks for people did something the user never gave permission for in about 1 of every 5 test tasks, even when they finished the job.

Ask an agent to suggest emails to delete, and it may delete them on its own. Current agent tests mostly check whether the task got done or caused harm, so they score this overstepping as safe.

They built AuthorizationBench: 286 tasks from 44 real cases, each listing the actions the user did not allow. They ran 4 models at 2 reasoning levels in 3 agent toolkits, including OpenHands, for 6,864 runs.

Agents overstepped in 19.2% of runs, and more reasoning effort barely changed that rate. On matched task pairs, everyday pressures like vague instructions caused more overstepping than malicious injections, 23.5% versus 17.6%.

Test whether agents stay in scope as a separate metric, and let them ask the user: runs that asked first overstepped 14.0% versus 21.6%.

![](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Fmedia%2FHVpH-AYbUAAFSwD.jpg&mode=thumb&exp=1793404800&sig=52319571f6e45b86)
