Skip to content
View original post on X: Santiago
Published
31/100

Sentient OS builds on-device context for Mac using local Gemma 4 E4B

AISantiago (@svpino) says a Mac app builds context from files, messages, notes, emails, and calendar events to help users write messages and complete tasks. The app runs a local Gemma 4 E4B model through LiteRT-LM. Per the linked post, the app is Sentient OS, an on-device AI launched by Aditya Vellanki.
SantiagoVerified on X
@svpino
View on X

This app does a lot of what Siri should do on your Mac:

It builds context from files, messages, notes, emails, and calendar events, and then uses that information to help you write messages and complete tasks in the apps you use.

And it uses a local Gemma 4 E4B model running through LiteRT-LM!

Aditya Vellanki@aditya_vellanki
Today, we're launching Sentient OS (YC F26), on-device AI that understands your life overnight with a local LLM. This unlimited inference enables 2 magical experiences 🧵
View quoted post on X
Source details

Santiago · x.comPublished

Original title: This app does a lot of what Siri should do on your Mac:

Topics

On-device AIOpen-source ecosystemDeployment & engineeringProduct updates