Skip to content
Read the original: OpenBMB (MiniCPM) · new models on Hugging Face· Published 32/100AI score32/100

MiniCPM5-2B-DSpark draft model released for speculative decoding with MiniCPM5-2B

Original titleopenbmb/MiniCPM5-2B-DSpark

AISummary

OpenBMB released MiniCPM5-2B-DSpark, a 323,776,001-parameter DSpark draft checkpoint with five layers that proposes seven draft tokens per forward pass for the MiniCPM5-2B target model.

The model, trained on 7,054,154,509 tokens with an average acceptance length of 5.5174 at T=0 and 4.0514 at T=1.0, is served through SGLang with DSPARK speculative decoding. It is released in BF16 under the Apache-2.0 License.

Read the original huggingface.co

Source: OpenBMB (MiniCPM) · new models on Hugging Face · huggingface.coPublished · added here