Skip to content
Trending storyDeveloping

Aleksey Smolenchuk introduces Phone Use, agent control of a real iPhone

1 article1 sourcesince Nov 6Last article

Overview

AISummary of 1 article

Aleksey Smolenchuk introduces Phone Use, a tool that lets an agent control a real iPhone from a Linux machine over Bluetooth and AirPlay.

The agent views the screen through AirPlay and taps and types through a Bluetooth mouse and keyboard. No jailbreak or app on the phone is required. Text is read through OCR, so screenshots are not needed for every interaction.

Written by AI from the articles below · updated Nov 7, 2:09 PM ET

Check the sources:

Latest developmentNov 6, 8:42 PM ET
Phone Use lets agents control a real iPhone over Bluetooth and AirPlay

Article timeline

The articles in this story. Times are ET.

Nov 6
  1. Aleksey SmolenchukX
    Phone Use lets agents control a real iPhone over Bluetooth and AirPlay

    AIAleksey Smolenchuk introduces Phone Use, which lets an agent control a real iPhone from a Linux machine over Bluetooth and AirPlay. The agent watches the screen through AirPlay and taps and types as a Bluetooth mouse and keyboard, with no jailbreak or app on the phone. Text is read out of band through OCR, so screenshots are not needed for every interaction.

    Video from @lxe's post

Heat Trend

Not enough continuous observations to show a trend yet.