GitHub releases ReviewBench, an open benchmark for AI code review agents

GitHub has released ReviewBench, an open benchmark for evaluating AI code review agents on 219 public pull requests across 19 languages.

The benchmark reports grounded and augmented precision, recall, and F1 metrics, and its dataset, rubric, and judge are publicly available.

GitHub says ReviewBench predicted the direction of a Copilot code review ensemble experiment's production results before A/B testing.