vLLM explains Beam's MoE, attention, and speculative drafting design

Inside Beam: 8 of 256 experts are active per token across 52 layers.

Attention alternates a 512-token sliding window with global NoPE attention, pairing local processing with access to long context.

Harmony carries the reasoning and tool-use structure. A separate 5-layer drafter supplies speculative tokens.