AA-Paperclip tests models on extracting facts and making decisions about real-world documents. Each of its 1,500 private documents has five decisions and ten facts to extract. The key metric measures the share of documents where a model answers all 15 questions correctly. For the Decision Score, the model’s confidence in a document is the product of its 15 answer probabilities.
Claude Haiku 5.5 (Max) passes 92% of documents and GPT-6 Luna (Max) passes 86%. Drex Max v1.1 (63%) and GLiDE v1.2 (62%) lead the decision models, followed by Decider v1.2 (55%). The all-pass requirement separates models that look close on individual answers. Drex Max v1.1 gets 97% of answers right, close to Claude Haiku 5.5 (Max) at 99%, but passes 63% of documents against Haiku's 92%. Decision models lose most documents on the decisions rather than extraction, with Drex Max v1.1 correctly making all five decisions on 71% of documents and all ten extractions on 88%.