Google describes a real-time classifier built on EmbeddingGemma 2
Overview
Google's Gemma account says a community project trains a lightweight classifier on EmbeddingGemma 2 in real time, instead of running a full multimodal LLM. The post says the classifier can learn new categories on the fly and runs locally in about 20ms for text and 100ms for images.
The project's author, mmastrac, has open-sourced the approach as hunch, which exposes it as a real-time /v1/systemone endpoint. The author says it is multimodal by default and can distill an upstream teacher model.
Written by AI from the articles below · updated Nov 4, 12:52 PM ET
Check the sources:
Developments
2 developments
- Nov 4, 12:44 PM ET · 1 articleGoogle describes a real-time classifier built on EmbeddingGemma 2Google Gemma: Google shows a community classifier running on EmbeddingGemma 2 in real time
- Nov 4, 12:44 PM ET · 1 articlemmastrac open-sources hunch for real-time multimodal inferenceGoogle Gemma: Gemma-based real-time inference project hunch is open-sourced by mmastrac
Article timeline
The articles in this story. Times are ET.
Google Gemma@googlegemmaOfficialGemma-based real-time inference project hunch is open-sourced by mmastracAImmastrac has open-sourced hunch, a project that uses EmbeddingGemma2 as a real-time /v1/systemone endpoint. The endpoint runs in about 20ms on text and 100ms on images, is trainable in real time, and can distill an upstream teacher model. The author says the approach is multi-modal by default and invites others to try it on GitHub.
Google Gemma@googlegemmaOfficialGoogle shows a community classifier running on EmbeddingGemma 2 in real timeAIGoogle says a community project trains a lightweight classifier on top of EmbeddingGemma 2 in real time, instead of running a full multimodal LLM. The post says the model can learn new categories on the fly and classify inputs locally in about 20ms for text and 100ms for images.

Heat Trend
Not enough continuous observations to show a trend yet.