ReplaySSM rethinks state storage to speed hybrid-model decoding

NVIDIA's technical blog presents ReplaySSM, a method that changes how state-space model layers store state to speed decoding in hybrid models.

The post says hybrid models such as NVIDIA Nemotron 3, Qwen3.5 through Qwen3.8, Kimi-K3, and GLM-5.3-Flash interleave SSM layers with a few attention layers, using Mamba-2, Gated DeltaNet, or Kimi Delta Attention as the SSM layer.

The source excerpt provided does not give benchmark results, so the speed gains are not quantified here.