Santiago argues deterministic tests should enforce agent rules instead of written instructions
Overview
Santiago (@svpino) argues on X that rules an agent must follow should be enforced by deterministic tooling rather than written instructions when the rule can be checked.
He lists unit and integration tests for behavior, formatters and linters for formatting, static type checkers for types, schema validation for API contracts, and static analysis and security scans for security. He says telling an agent to follow rules that tests could enforce wastes tokens. The post is a single opinion and reports no measured results.
Written by AI from the articles below · updated Oct 31, 9:18 AM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
Santiago@svpinoXDeterministic tests beat written instructions for enforcing agent rulesAISantiago argues that anything checkable should be enforced by deterministic tooling rather than written instructions. He lists unit and integration tests for behavior, formatters and linters for formatting, static type checkers for types, schema validation for API contracts, and static analysis and security scans for security. He says telling an agent to follow rules that tests could enforce wastes tokens.
Heat Trend
Not enough continuous observations to show a trend yet.