Skip to content
Trending storyDeveloping

Google Cloud Tech says LLM text output is poor for classification decisions

1 article1 sourcesince Oct 16Last article 1h ago ·

Overview

AISummary of 1 article

Google Cloud Tech post by Logan Hennessy argues that LLMs used as drop-in classifiers return text rather than probabilities, which blocks thresholding, abstention, and auditing.

Hennessy says discriminative models predict a fixed label set in a single forward pass and avoid the sequential cost of autoregressive generation. He cites Gemini's SafetyRating objects as an example of generation and classification returned together in one API response.

Written by AI from the articles below · updated Oct 16, 3:15 PM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 16
  1. Google Cloud TechOfficial
    Google Cloud Tech argues LLMs should not be used as drop-in classifiers

    AILogan Hennessy argues that LLMs used as drop-in classifiers return text rather than probabilities, which blocks thresholding, abstention, and auditing. He says discriminative models predict a fixed label set in a single forward pass and avoid the sequential cost of autoregressive generation. He points to Gemini's SafetyRating objects as an example of generation and classification returned together in one API response.

Heat trend

Not enough continuous observations to show a trend yet.