I am still very bullish on local LLMs. We have yet to see its biggest unlock.
I am particularly curious to see what's possible with unlimited inference.
One exciting application is using local models to run always-on proactive agents cheaply.
Great to see Sentient OS pushing for this. It uses a local LLM on your computer to read your context overnight, then keeps what it learns as markdown files you own.
