Parsimony benchmarks how much code AI models add to patches
Original titleShow HN: Parsimony – an open-source benchmark for how much code AI models add
AISummary
Parsimony, an open-source benchmark, measures how much code AI models add by counting net coding units, with deleted code subtracted, instead of lines. It ranks models by mean net units added on SWE-bench Verified tasks, lowest first, and counts failed attempts in the mean. Only Python is measured, and the benchmark does not rerun tests.
Source: Hacker News · Show HN, AI (20+ points) · parsimony.lasu.devPublished · added here