Skip to content
Trending storyDeveloping

Google describes a real-time classifier built on EmbeddingGemma 2

2 articles1 sourcesince Nov 4Last article 1h ago ·

Overview

AISummary of 2 articles

Google's Gemma account says a community project trains a lightweight classifier on EmbeddingGemma 2 in real time, instead of running a full multimodal LLM. The post says the classifier can learn new categories on the fly and runs locally in about 20ms for text and 100ms for images.

The project's author, mmastrac, has open-sourced the approach as hunch, which exposes it as a real-time /v1/systemone endpoint. The author says it is multimodal by default and can distill an upstream teacher model.

Written by AI from the articles below · updated Nov 4, 12:52 PM ET

Check the sources:

Developments

2 developments

  1. Nov 4, 12:44 PM ET · 1 article
    Google describes a real-time classifier built on EmbeddingGemma 2
    Google Gemma: Google shows a community classifier running on EmbeddingGemma 2 in real time
  2. Nov 4, 12:44 PM ET · 1 article
    mmastrac open-sources hunch for real-time multimodal inference
    Google Gemma: Gemma-based real-time inference project hunch is open-sourced by mmastrac

Article timeline

The articles in this story. Times are ET.

Nov 4
  1. Google GemmaOfficial
    Gemma-based real-time inference project hunch is open-sourced by mmastrac

    AImmastrac has open-sourced hunch, a project that uses EmbeddingGemma2 as a real-time /v1/systemone endpoint. The endpoint runs in about 20ms on text and 100ms on images, is trainable in real time, and can distill an upstream teacher model. The author says the approach is multi-modal by default and invites others to try it on GitHub.

  2. Google GemmaOfficial
    Google shows a community classifier running on EmbeddingGemma 2 in real time

    AIGoogle says a community project trains a lightweight classifier on top of EmbeddingGemma 2 in real time, instead of running a full multimodal LLM. The post says the model can learn new categories on the fly and classify inputs locally in about 20ms for text and 100ms for images.

    Video from @googlegemma's post

Heat Trend

Not enough continuous observations to show a trend yet.