Collinear AI releases CWE-bench v2 with 100 public security-fix tasks
AICollinear AI releases CWE-bench v2, a public set of 100 tasks across 91 CWEs in which agents must find and fix security weaknesses without breaking existing functionality. Among 11 evaluated models, Gemini 4 Argon leads with 67.8% pass@1 and 81.0% pass@4, ahead of Claude Opus 5.5 at 67.3% and 78.0%.
Source details
Hugging Face Blog · huggingface.coPublished · added here
Original title: CWE-bench v2: More coverage, quality, and transparency