New research from Microsoft Research demonstrates that reprogramming just a few dormant neurons in an AI agent can create a backdoor that leaves the agent behaving normally until it hits a specific trigger.
While the specifics of this threat are novel, the mitigation is not: Know where your model came from, and be smart about its permissions. Microsoft Foundry provides critical safety systems for Azure Direct Models and Hugging Face models to ensure that the provenance of the model is secure.
Microsoft researcher @DimitrisPapail explains the measures that model hubs and vendors should take as well as mitigation strategies for enterprises and users. https://msft.it/6014ahp6e