DigitalOcean's Signals flags production agent sessions where users got frustrated or tools failed and converts them into evals with one click. Simulations then replay those sessions against a fix on the agent's real harness before it ships.
Your agent traces are your best eval data.
The most important failures only show up in production, and they rarely make it into your test set.
DigitalOcean's Signals flags sessions where users got frustrated or tools failed and turns them into evals with one click. Simulations then replay them against your fix on your agent's real harness before it ships.
If you're running agents in production, you need this loop.
https://x.com/digitalocean/status/2109658818196242684/video/1
Catch it at the first user, not the four-hundredth. A new user’s bank link fails, the agent says “try again later,” and nothing shows up in the logs. Watch a team find the bug and fix it before anyone else hits it, with Agent Learning Services and Agent Data Services, launching today.
Source: elvis · x.comPublished · added here
