Thrive Holdings publishes its first real-world AI benchmarks for tax and IT work
Overview
Thrive Holdings publishes its first set of AI model benchmarks drawn from work across its more than 75 accounting and IT services firms, at evals.thriveholdings.com.
The company says it uses the tests to compare model configurations and choose which models its systems run on, with the goal of better service to customers. Thrive Holdings says the field needs more benchmarks tied to economically valuable work so builders can see where models are useful in real environments. OpenAI's Boris Power praised the release on X.
Written by AI from the articles below · updated Oct 16, 10:55 AM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
Boris Power@BorisMPowerXThrive Holdings publishes real-world AI benchmarks for tax and IT workAIBoris Power, OpenAI's account on X, praises Thrive Holdings' first real-world benchmarks for tax and IT services. Thrive Holdings, which runs more than 75 accounting and IT services firms, uses the tests to choose which models run its systems. The benchmarks are published at evals.thriveholdings.com.
Heat trend
Not enough continuous observations to show a trend yet.