Google Cloud Tech says LLM text output is poor for classification decisions
Overview
Google Cloud Tech post by Logan Hennessy argues that LLMs used as drop-in classifiers return text rather than probabilities, which blocks thresholding, abstention, and auditing.
Hennessy says discriminative models predict a fixed label set in a single forward pass and avoid the sequential cost of autoregressive generation. He cites Gemini's SafetyRating objects as an example of generation and classification returned together in one API response.
Written by AI from the articles below · updated Oct 16, 3:15 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
Google Cloud Tech@GoogleCloudTechOfficialGoogle Cloud Tech argues LLMs should not be used as drop-in classifiersAILogan Hennessy argues that LLMs used as drop-in classifiers return text rather than probabilities, which blocks thresholding, abstention, and auditing. He says discriminative models predict a fixed label set in a single forward pass and avoid the sequential cost of autoregressive generation. He points to Gemini's SafetyRating objects as an example of generation and classification returned together in one API response.
Heat trend
Not enough continuous observations to show a trend yet.