I feel stupid saying this, but you gotta make sure your agents don't repeat the same mistake.
Every time you find an issue that goes through your agentic review, ask the following:
• What specific check should have caught this bug?
• At what stage should that check have run?
• Why didn't the existing tests, rules, or instructions catch it?
• What can we change so this problem gets caught automatically?
Then:
• If it was a missing test, write one.
• If it was a missing review rule, add it.
• If the instructions were unclear, improve them.
• If the agent was missing context, provide it.
I know it's tempting to fix the issue and move on, but this is not smart.
Take a minute to fix the process that let the problem happen in the first place.
