Paper shows backdoored AI models can hide capabilities from elicitation-based audits
Overview
Andis Draguns et al. publish a backdoor attack that embeds encrypted neural networks in a host model's weights and runs them only when a secret trigger is received.
The authors say that, under cryptographic assumptions and using digital lockers, the hidden circuits stay provably hard to elicit or interpret even with full access to the weights. The paper extends earlier work that hid fixed strings to hiding arbitrary computations.
The team tested fine-tuning, weight noising, gradient-based trigger search and latent adversarial training on a small chemical reaction prediction task, which they present as a proxy for CBRN-relevant capabilities. The models resisted these methods. The authors release the models to support work on defenses.
Written by AI from the articles below · updated Oct 13, 4:07 AM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
- Hacker News · AI (150+ points)BlogResearchers show AI models can provably hide arbitrary capabilities from audits
AIResearchers show that backdoor attacks can embed encrypted neural networks in model weights and run them only when a secret trigger is received. Under cryptographic assumptions, the hidden circuits remain hard to elicit or interpret even with full weight access. The team tested fine-tuning, weight noising, gradient-based trigger search, and latent adversarial training on a small chemical reaction prediction task, a proxy for CBRN-relevant capabilities. The models resisted these methods, and the team released them to support defense research.
Heat trend
Not enough continuous observations to show a trend yet.