Skip to content
Trending storyDeveloping

Paper shows backdoored AI models can hide capabilities from elicitation-based audits

1 article1 sourcesince Oct 12Last article

Overview

AISummary of 1 article

Andis Draguns et al. publish a backdoor attack that embeds encrypted neural networks in a host model's weights and runs them only when a secret trigger is received.

The authors say that, under cryptographic assumptions and using digital lockers, the hidden circuits stay provably hard to elicit or interpret even with full access to the weights. The paper extends earlier work that hid fixed strings to hiding arbitrary computations.

The team tested fine-tuning, weight noising, gradient-based trigger search and latent adversarial training on a small chemical reaction prediction task, which they present as a proxy for CBRN-relevant capabilities. The models resisted these methods. The authors release the models to support work on defenses.

Written by AI from the articles below · updated Oct 13, 4:07 AM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 12
  1. Hacker News · AI (150+ points)Blog
    Researchers show AI models can provably hide arbitrary capabilities from audits

    AIResearchers show that backdoor attacks can embed encrypted neural networks in model weights and run them only when a secret trigger is received. Under cryptographic assumptions, the hidden circuits remain hard to elicit or interpret even with full weight access. The team tested fine-tuning, weight noising, gradient-based trigger search, and latent adversarial training on a small chemical reaction prediction task, a proxy for CBRN-relevant capabilities. The models resisted these methods, and the team released them to support defense research.

Heat trend

Not enough continuous observations to show a trend yet.