Skip to content
Read the original: Cohere · new models on Hugging Face· Published 14/100AI score14/100

CohereLabs releases Eagle draft model for North-Mini-Code-1.0 speculative decoding

Original titleCohereLabs/North-Mini-Code-1.0-eagle

AISummary

CohereLabs has published North-Mini-Code-1.0-eagle, an Eagle draft model for its North-Mini-Code-1.0 target model. The three-layer draft uses dense transformer blocks and sliding window attention, and it is compatible with fp8 and w4a16 target checkpoints in vLLM.

Read the original huggingface.co

Source: Cohere · new models on Hugging Face · huggingface.coPublished · added here