Liquid AI says d1-ultra has the lowest calibration error of tested models
Overview
Liquid AI says its d1-ultra model has the lowest calibration error of any model it tested.
The company says that when d1-ultra reports 90% confidence, it is right at least 90% of the time. Liquid AI says users can set a confidence threshold, automate decisions above it, and send the rest to a person.
The claim comes from a post on Liquid AI's X account, which does not include the test set, the models compared, or the calibration metric used.
Written by AI from the articles below · updated Oct 15, 1:14 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
Liquid AI@liquidaiOfficialLiquid AI says d1-ultra's confidence scores are well calibratedAILiquid AI says d1-ultra has the lowest calibration error of any model it tested, so when it reports 90% confidence, it is right at least 90% of the time. The company says users can set a confidence threshold to automate decisions above it and route the rest to a person.

Heat trend
Not enough continuous observations to show a trend yet.