ViBench 2.0 benchmark tests whether AI models can build full software products
AIReplit releases ViBench 2.0, a benchmark in which models build 17 products from an empty project, adding 241 feature requests and passing 544 test plans. The best models, GPT-6.1 Sol, GPT-6 Astra and Opus 5.5, pass all test plans in only 49 to 65% of builds.
Source details
Replit Blog · replit.comPublished · added here
Original title: ViBench 2.0: A Benchmark for Long-Horizon Software Building