Llmspeed estimates local LLM speed by hardware before purchase
Overview
Llmspeed, a Show HN web tool, estimates how fast local LLMs run on specific hardware, such as an NVIDIA RTX 4090 or a Mac Studio M3 Ultra, so buyers can check before purchasing.
According to the project page, some figures come from community benchmarks such as r/LocalLLaMA and localscore.ai, while others are derived from similar setups or projected from hardware specs. The estimates cover a short prompt on a single device. The project is open source on GitHub.
Written by AI from the articles below · updated Oct 17, 3:37 AM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
- Hacker News · Show HN, AI (20+ points)BlogLlmspeed estimates how fast local LLMs run on different hardware
AILlmspeed is a Show HN tool that estimates how fast local LLMs run on specific hardware, such as NVIDIA RTX 4090 and Mac Studio M3 Ultra, before buying it. The page says measured figures come from community benchmarks like r/LocalLLaMA and localscore.ai, while others are derived from similar setups or projected from specs. The estimates cover a short prompt on a single device, and the project is open source on GitHub.
Heat trend
Not enough continuous observations to show a trend yet.