Phone Use lets agents control a real iPhone over Bluetooth and AirPlay

AIAleksey Smolenchuk introduces Phone Use, which lets an agent control a real iPhone from a Linux machine over Bluetooth and AirPlay. The agent watches the screen through AirPlay and taps and types as a Bluetooth mouse and keyboard, with no jailbreak or app on the phone.

Aleksey Smolenchuk

@lxe

View on X

Computer use is over.

Introducing PHONE USE!

http://github.com/lxe/phoneuse

My real actual iPhone on my desk via Bluetooth and AirPlay connected to my Linux machine.

Textualization OCR happens out of band so we don't use screenshots all the time. There are recipes for all interactions. Agent skill for your robots.

You literally can just do anything now.

Aleksey Smolenchuk@lxe

I can now control my phone with an agent. It watches the screen over airplay and taps and types as a Bluetooth mouse and keyboard, no jailbreak and no app on the phone. It put sushi in my DoorDash cart and wrote this post

View quoted post on X

Source details

Aleksey Smolenchuk · x.comPublished Nov 6, 8:42 PM ET · added here Nov 7, 2:07 PM ET

Original title: Computer use is over.

Topics

AI agents Open-source ecosystem MCP & tool use