Skip to content
Read the original: Hacker News · Show HN, AI (20+ points)Blog· 42/100AI score42/100

Parsimony benchmarks how much code AI models add to patches

Original titleShow HN: Parsimony – an open-source benchmark for how much code AI models add

AISummary

Parsimony, an open-source benchmark, measures how much code AI models add by counting net coding units, with deleted code subtracted, instead of lines. It ranks models by mean net units added on SWE-bench Verified tasks, lowest first, and counts failed attempts in the mean. Only Python is measured, and the benchmark does not rerun tests.

Read the original parsimony.lasu.dev

Source: Hacker News · Show HN, AI (20+ points) · parsimony.lasu.devPublished · added here