Skip to content
View original post on X: Rohan PaulX· 40/100AI score40/100

Sentient releases open benchmark for AI model fingerprinting and copy detection

AISummary

Sentient Foundation released the Fingerprinting Leaderboard, a free open-source benchmark that tests methods for hiding ownership marks in AI models.

The benchmark embeds each submitted mark in Sentient's test models, tries to strip it out, and ranks methods on a public site, with the mlprints test code also released.

Sentient's Perinucleus method embedded 24,576 fingerprints in Llama-3.1-8B without degrading utility and survived standard fine-tuning.

Post on XView on X
Rohan PaulVerified on X
@rohanpaul_ai

Good news for anyone trying to prove a model is theirs.

Sentient Foundation released the Fingerprinting Leaderboard, a free, open source benchmark that tests fingerprinting methods, meant to prove an AI model was copied from yours.

Researchers submit a method for hiding an ownership mark inside a model, and Sentient puts that mark into its own test models, tries to strip it out, then ranks the method on a public website.

The code that runs these tests, called mlprints, is released too.

A fingerprint trains a model to return unlikely answers to secret prompts, so an owner can test a suspected copy through its API alone.

But a fingerprint that survives every attack is still useless if the owner can’t read it back reliably.

Sentient Foundation’s Fingerprinting Leaderboard scores that verification step directly, alongside how well the mark resists removal and how much model skill it costs.

Sentient’s Perinucleus method embedded 24,576 fingerprints in Llama-3.1-8B without degrading utility, is also competing on the leaderboard, and the fingerprints survived standard fine-tuning.

Sentient Foundation@sentient_found
Models cost millions to train and minutes to copy. Fine-tuning and distillation can erase where they came from. Introducing the Fingerprinting Leaderboard, an open benchmark for model provenance — built so the proof lives in the weights, not the paperwork. https://fingerprint.sentient.foundation
View quoted post on X

Source: Rohan Paul · x.comPublished · added here