Skip to content
Trending storyDeveloping

Santiago argues deterministic tests should enforce agent rules instead of written instructions

1 article1 sourcesince Oct 31Last article 1h ago ·

Overview

AISummary of 1 article

Santiago (@svpino) argues on X that rules an agent must follow should be enforced by deterministic tooling rather than written instructions when the rule can be checked.

He lists unit and integration tests for behavior, formatters and linters for formatting, static type checkers for types, schema validation for API contracts, and static analysis and security scans for security. He says telling an agent to follow rules that tests could enforce wastes tokens. The post is a single opinion and reports no measured results.

Written by AI from the articles below · updated Oct 31, 9:18 AM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 31
  1. SantiagoX
    Deterministic tests beat written instructions for enforcing agent rules

    AISantiago argues that anything checkable should be enforced by deterministic tooling rather than written instructions. He lists unit and integration tests for behavior, formatters and linters for formatting, static type checkers for types, schema validation for API contracts, and static analysis and security scans for security. He says telling an agent to follow rules that tests could enforce wastes tokens.

Heat Trend

Not enough continuous observations to show a trend yet.