Skip to content
Trending storyDeveloping

Together AI argues token efficiency should top model evaluation criteria

1 article1 sourcesince Nov 9Last article 4h ago ·

Overview

AISummary of 1 article

Together AI says comparing AI models by price sheet misses half the cost picture, and that token efficiency belongs at the top of evaluation criteria.

The claim was made at Open by Design NYC by NVIDIA's Jacob Loewenstein, in a discussion that also included Reflection's Zach Wentz and Together AI's Hassan El Mghari. The report, posted on X by Together AI, gives no figures or test results behind the argument.

Written by AI from the articles below · updated Nov 9, 4:15 PM ET

Check the sources:

Latest developmentNov 9, 4:09 PM ET
Together AI argues token efficiency should top model evaluation criteria

Article timeline

The articles in this story. Times are ET.

Nov 9
  1. Together AIOfficial
    Together AI argues token efficiency should top model evaluation criteria

    AITogether AI says comparing models by price sheet misses half the cost math, and that token efficiency belongs at the top of evaluation criteria. NVIDIA's Jacob Loewenstein made the case at Open by Design NYC, a discussion that also included Reflection's Zach Wentz and Together AI's Hassan El Mghari.

    Video from @togethercompute's post

Heat Trend

Current comparable heat
9
Peak comparable heat
10Nov 9, 5:00 PM ET
Change in past 24 hours
–

The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.