DigitalOcean launches Signals and Simulations to turn failed agent sessions into tests
Overview
DigitalOcean has launched Agent Learning Services, including Signals, Simulations and Insights in public preview, and Agent Data Services in private preview.
Testing Catalog says Signals reads live agent traffic and flags failed sessions, such as a successful tool call that queried the wrong region. Users can turn a flagged session into a test that Simulations replays against a proposed fix before it ships.
Elvis Saravia says Signals flags sessions where users became frustrated or tools failed, and converts them into evals with one click. Rohan Paul says Signals uses rule-based checks for signs such as repeated user messages, requests for a human, and looping tool retries, and that Simulations replays flagged sessions with a fake user against the fixed agent. Paul's post says teams no longer need to pay an LLM to grade every conversation or write test cases by hand.
Written by AI from the articles below · updated Oct 12, 12:38 PM ET
Check the sources:
Developments
2 developments
- Oct 12, 11:27 AM ET · 2 articlesDigitalOcean launches public preview of Signals, Simulations, and Insights and private preview of Agent Data ServicesRohan Paul: DigitalOcean launches Signals and Simulations to catch silent AI agent failures
- Oct 12, 11:23 AM ET · 1 articleDigitalOcean launches Agent Learning Services and Agent Data Services to turn production agent failures into evalsElvis Saravia: DigitalOcean's Signals turns failed agent sessions into one-click evals
Article timeline
The articles in this story. Times are ET.
Rohan Paul@rohanpaul_aiXDigitalOcean launches Signals and Simulations to catch silent AI agent failuresAIDigitalOcean launches Signals, which watches live agent sessions with rule-based checks for signs like repeated user messages, requests for a human, and looping tool retries. Flagged sessions go to Simulations, which replays them with a fake user against the fixed agent before release. The post says teams no longer need to pay an LLM to grade every conversation or write test cases by hand.

🚨 AI News | TestingCatalog@testingcatalogXDigitalOcean launches Signals, Simulations, and Insights for AI agentsAIDigitalOcean launches Signals, Simulations, and Insights in public preview, and Agent Data Services in private preview. Signals reads live agent traffic and flags failed sessions, such as a successful tool call that queried the wrong region. Users can turn a flagged session into a test that Simulations replays with a proposed fix.

elvis@omarsar0XDigitalOcean's Signals turns failed agent sessions into one-click evalsAIDigitalOcean's Signals flags production agent sessions where users got frustrated or tools failed and converts them into evals with one click. Simulations then replay those sessions against a fix on the agent's real harness before it ships.

Heat trend
Not enough continuous observations to show a trend yet.