What did the agent actually get done? @zapier's AutomationBench puts that question to the test across 47 simulated apps, grading the results agents leave behind.
Thank you to the Zapier team for partnering with us to bring this benchmark to the Specialized Intelligence Index!
Explore how they built it: https://zapier.com/blog/automationbench-on-specialized-intelligence-index/
Zapier's AutomationBench is now on @FireworksAI_HQ's Specialized Intelligence Index! Agents work across 47 simulated apps spanning sales, marketing, ops, support, finance, & HR We grade whether they correctly finished the workflow, so teams can pick models on what gets done 🤝
Fireworks · x.comPublished · added here
Original title: What did the agent actually get done? @zapier's AutomationBench puts that question to the test across 47 simulated apps, grading the res...
