ForgeKernel, an AI-written operator, ranks first on NVIDIA and Huawei kernel benchmarks
Overview
ForgeKernel, an operator written entirely by AI with no manual line-by-line tuning, ranks first on two operator benchmarks as of October 22, according to Leiphone (雷峰网).
It ranks first on NVIDIA's SOL-ExecBench FlashInfer-Bench collection and on the CANNBench A3 hardware leaderboard in Huawei's Ascend CANN repository, with a 1.835× benchmark speedup, 25% ahead of the second-place entry.
OpenBMB, which describes ForgeKernel as a self-evolving kernel optimization harness in its Forge series, says it ranked #1 on every leaderboard it tested, including the same two. OpenBMB says a paper on ForgeKernel will follow. Leiphone's report places the result in the same week DeepSeek open-sourced its DeepInfer inference framework, but does not say whether ForgeKernel is connected to DeepSeek.
Written by AI from the articles below · updated Oct 28, 1:58 AM ET
Check the sources:
Developments
3 developments
- Oct 28, 1:43 AM ET · 1 articleOpenBMB praises ForgeKernel, a self-evolving kernel optimisation harness, reaching #1 on SOL-ExecBench and CANN-BenchOpenBMB: OpenBMB praises ForgeKernel, a self-evolving kernel optimization harness
- Oct 27, 3:09 AM ET · 1 articleForgeKernel tops CANNBench Ascend operator leaderboard across three chip tracksPandaily: ForgeKernel tops CANNBench's Ascend operator leaderboard on all three tracks
- Oct 26, 2:58 AM ET · 1 articleForgeKernel, an AI-written operator, tops two operator benchmarksLeiphone: ForgeKernel, an AI-written operator, tops two kernel benchmarks after DeepSeek's DeepInfer release
Article timeline
The articles in this story. Times are ET.
OpenBMB@OpenBMBOfficialOpenBMB praises ForgeKernel, a self-evolving kernel optimization harnessAIOpenBMB's post follows up on JustGoal with a self-evolving kernel optimization harness, ForgeKernel, part of the Forge series. Per the quoted post by @_LiYuXuan_, ForgeKernel ranked #1 on every leaderboard tested, including NVIDIA's SOL-ExecBench (FlashInfer-Bench) and HUAWEI's CANN-Bench. A paper on ForgeKernel is forthcoming.
- PandailyNewsForgeKernel tops CANNBench's Ascend operator leaderboard on all three tracks
AIEntries under the name ForgeKernel hold first place on all three hardware tracks of CANNBench, the CANN community's public leaderboard for AI-generated Ascend operators, as of October 27. On the 950PR track, ForgeKernel scores 3,649.86 with 49 of 60 operators passing and a 1.876 times geometric mean speedup, ahead of CANNBot PyPTOPro S2 frontier at 3,552.34. The three top entries carry only the ForgeKernel organisation label, and Pandaily could not identify the developer.
- LeiphoneNewsForgeKernel, an AI-written operator, tops two kernel benchmarks after DeepSeek's DeepInfer release
AIDeepSeek recently open-sourced its DeepInfer inference framework, following its model weights and operator libraries such as FlashMLA and DeepGEMM. In the same week, ForgeKernel, an operator written entirely by AI with no manual line-by-line tuning, ranked first on NVIDIA's SOL-ExecBench FlashInfer-Bench collection and on the Ascend CANNBench A3 hardware leaderboard as of October 22, with a 1.835× benchmark speedup, 25% ahead of second place.
Heat Trend
- Current comparable heat
- 13
- Peak comparable heat
- 18Oct 28, 2:00 AM ET
- Change in past 24 hours
- -3%
The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.