Skip to content
Trending storyDeveloping

Sentient launches open Fingerprinting Leaderboard for scoring model provenance methods

2 articles2 sourcessince Oct 14Last article 2h ago ·

Overview

AISummary of 2 articles

Sentient has launched the Fingerprinting Leaderboard, a free, open-source benchmark that scores methods for hiding ownership marks in AI models, according to Elvis Saravia and Rohan Paul's reports on X. Each method is measured on how much model quality it preserves, how well it survives removal attempts such as fine-tuning and distillation, and how reliably the owner can detect it.

The benchmark embeds each submitted mark in Sentient's test models, tries to strip it out, and ranks methods on a public site. Sentient released the mlprints code that runs the tests. Sentient says the aim is to keep proof of provenance in the model weights rather than in documentation.

Paul reports that Sentient's Perinucleus method embedded 24,576 fingerprints in Llama-3.1-8B without degrading utility and survived standard fine-tuning. The reports do not give results for any other method.

Written by AI from the articles below · updated Oct 14, 11:37 AM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 14
  1. Rohan PaulX
    Sentient releases open benchmark for AI model fingerprinting and copy detection

    AISentient Foundation released the Fingerprinting Leaderboard, a free open-source benchmark that tests methods for hiding ownership marks in AI models. The benchmark embeds each submitted mark in Sentient's test models, tries to strip it out, and ranks methods on a public site, with the mlprints test code also released. Sentient's Perinucleus method embedded 24,576 fingerprints in Llama-3.1-8B without degrading utility and survived standard fine-tuning.

    Image from @rohanpaul_ai's post
  2. elvisX
    Sentient launches an open leaderboard for model fingerprinting methods

    AISentient has launched the Fingerprinting Leaderboard, an open benchmark for model provenance that scores fingerprinting methods. Each method is measured on how much model quality it preserves, how well it survives removal attempts such as fine-tuning and distillation, and how reliably the owner can detect it.

Heat trend

Not enough continuous observations to show a trend yet.