Unsloth says it created UD-3 GGUF quants for NVIDIA's Nemotron 3.5 Bolt and Super models, plus NVFP4 GGUFs for Super. It also ran KLD benchmarks for both models and links to documentation with the results. The post says Bolt runs well on RTX Spark.
The post gives specific GGUF quant formats, memory footprints and KL benchmark plots, which help readers choose a quant for local deployment.
We created some Unsloth UD-3 GGUF quants for NVIDIA's Nemotron 3.5 Super and Bolt model!
Bolt runs great in RTX Spark!
We also made NVFP4 GGUFs for Super!
We also ran KLD benchmarks for both - docs at https://unsloth.ai/docs/models/nemotron-3.5-super-vl and https://unsloth.ai/docs/models/nemotron-3.5-bolt
NVIDIA releases 2 new models: Nemotron-3.5-Bolt and Nemotron-3.5-Super-VL. Nemotron-3.5-Bolt-74B-A9B runs on 24GB RAM. It delivers top-tier performance for its size. Super-VL-120B-A12B runs on 82GB RAM. Bolt GGUF: https://huggingface.co/unsloth/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-GGUF Guide: https://unsloth.ai/docs/models/nemotron-3.5-bolt Super GGUF: https://huggingface.co/unsloth/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF
Source: Daniel Han · x.comPublished · added here
