Updated
Updated
Items with an AI score under 20 are hidden. Show low-relevance items
Rapid-MLX · local AI on your Mac@rapidmlxXAI score38AIRapid-MLX v0.16.0 introduces TensorFold profiles for running AI models locally on Mac. The post says DeepSeek V4 Flash gains up to 2.1× throughput, Bonsai 2 27B gains 42%, and Gemma 4 26B gains 4%.
OpenBMB@OpenBMBOfficialAI score28AIOpenBMB reports that its MiniCPM5-2B model runs at 37 tokens per second on an iPhone Air. The post presents this as evidence that small open multimodal models can run on mobile devices without a cloud GPU, with NobodyWho noting the model is available in its Chat app.
Santiago@svpinoXAI score34AIAtomic Agent Desktop is a local AI-first agent available for Mac, Windows, and Linux. It offers a 4x larger context window on local models using TurboQuant, and Atomic Fusion orchestrates cloud and local models to reduce costs.
🚨 AI News | TestingCatalog@testingcatalogXAI score62AIAtomic Agent Desktop is a free open-source app for macOS, Windows, and Linux that runs open models like Qwen and Gemma locally without an account. It connects to a cloud model only when selected, and its Fusion feature lets a cloud model plan a task while up to 8 local agents carry it out. The post's own text adds a setup wizard that checks RAM and suggests suitable models, and import from Claude Code, Codex, Hermes, and OpenClaw.
Zhihao Jia@JiaZhihaoXAI score62AILithos AI says it is open-sourcing lithos-metal, which uses megakernels and DSpark speculative decoding. The post claims Qwen3.8-27B reaches a peak of over 200 tokens per second per user on a single Apple M5 Max. It says users can try the tool with any coding agent in one command, and links to the code on GitHub and a technical blog.
merve@mervenoyannXAI score37AIllama.cpp v0.6.0 adds support for multimodal Jev-like models and a performance upgrade for Metal, according to Merve Noyan. The post says models can be served with a single command, `llama serve -hf ggml-org/Clef-Flash-GGUF`, and points to a trending list of decision models on Hugging Face.
Teknium 🪽@TekniumXAI score36AIDevelopers are running Hermes on devices such as LilyGO watches, AIPI Lite, desk gadgets, and old Android phones after the Hermes Gadget open SDK and demo were released three days ago. The post credits @NousResearch and says more boards are landing on main through contributor PRs, with the SDK available on GitHub.
TechCrunch@TechCrunchXAI score31AISigil Wen has built an on-device AI assistant that promises to be free, fully private, and capable for everyday tasks. The post says the startup is backed by prominent Silicon Valley investors, but does not name them or give product details.
AIMagnitude is an open source inference engine for agents that compiles and tunes its kernels on the user's device before running a model. The source claims up to 2x faster decoding than llama.cpp, citing 92% faster decode on Metal and 19% on CUDA, and says one click connects agents such as Pi, OpenCode, Codex, and Claude Code. It supports macOS, Windows, and Linux, and the source states that prompts and models stay on the user's machine.