Skip to content
View original post on X: Rohan PaulX· 46/100AI score46/100

DigitalOcean launches Signals and Simulations to catch silent AI agent failures

AISummary

DigitalOcean launches Signals, which watches live agent sessions with rule-based checks for signs like repeated user messages, requests for a human, and looping tool retries.

Flagged sessions go to Simulations, which replays them with a fake user against the fixed agent before release. The post says teams no longer need to pay an LLM to grade every conversation or write test cases by hand.

Post on XView on X
Rohan PaulVerified on X
@rohanpaul_ai

Agent failures often pass every health check. A tool call hits the wrong database region, returns 200, and the user gets a slower, worse answer. Nothing alerts.

DigitalOcean’s new tools flag agent sessions that fail silently, then replay them against a fix before release.

Because, the clue behind an agent bug is often sitting in something nobody can search.

Signals watches every live session with cheap rules, not an AI model, that look for human trouble signs such as a user repeating themselves, asking for a human, or a tool being retried in a loop, then passes those sessions to Simulations, which replays them with a fake user against your fixed agent to check the whole conversation works before the fix ships.

Until now teams had to pay an LLM to grade every conversation, read transcripts by hand, or invent test cases from imagination, while here the real failures from production automatically become the test set.

https://x.com/digitalocean/status/2109658000612835374/video/1

DigitalOcean@digitalocean
Catch it at the first user, not the four-hundredth. A new user’s bank link fails, the agent says “try again later,” and nothing shows up in the logs. Watch a team find the bug and fix it before anyone else hits it, with Agent Learning Services and Agent Data Services, launching today.
View quoted post on X

Source: Rohan Paul · x.comPublished · added here