Skip to content
View original post on X: Together AIOfficial
Published
22/100

Together AI argues token efficiency should top model evaluation criteria

AITogether AI says comparing models by price sheet misses half the cost math, and that token efficiency belongs at the top of evaluation criteria. NVIDIA's Jacob Loewenstein made the case at Open by Design NYC, a discussion that also included Reflection's Zach Wentz and Together AI's Hassan El Mghari.
Together AIVerified on XOfficial
@togethercompute
View on X

If you’re comparing models by their price sheet, you’re missing half the math.

Jacob Loewenstein @spatialjlo from NVIDIA explains why token efficiency belongs at the top of your evaluation criteria, whether you’re adopting a model or training your own.

One of the standout moments from Open by Design NYC, where Jacob, Zach Wentz @zkwentz from Reflection, and Hassan El Mghari @nutlope from Together AI chatted with builders digging into open models, post-training, and inference.

Source details

Together AI · x.comPublished

Original title: If you’re comparing models by their price sheet, you’re missing half the math.