Open-weight models trail closed models in cyber capabilities by 6–7 months

Epoch AI estimates that open-weight models trail closed-weight models by 6–7 months on cybersecurity capabilities, measured with a cyber-specific version of its Epoch Capabilities Index (ECI).

The estimates come from cybersecurity benchmark results alone, using benchmark parameters from a joint fit of the ECI on general and cyber benchmarks. Scores are on the same scale as the general ECI.