Redwood Research introduces Screwtape, a pipeline that edits transcripts to evade AI monitors
Original titleScrewtape: Adversarial Transcript Editing for Monitor Red-Teaming
AISummary
Redwood Research introduces Screwtape, a pipeline that inserts attacks into real agent transcripts and refines them until action-only monitors miss them.
The pipeline ran 252 times on 94 transcripts, producing 35 attacks that evaded Redwood's monitors and six that also evaded a held-out frontier developer monitor after human review.
The authors say the pipeline is better suited to finding monitor blind spots than to producing quantitative safety estimates, and they are not releasing its implementation publicly for now.
Source: Redwood Research Blog · blog.redwoodresearch.orgPublished · added here