Skip to content
Read the original: Daniel Han· Published 34/100AI score34/100

Hermes adds local backend supporting Unsloth GGUF quantized models

Original titleHermes now has a local backend!

AISummary

Hermes now includes a local backend that runs Unsloth UD-Q4_K_XL and UD-Q4_K_M quants for DeepSeek-V4-Flash, Qwen3.8-27B, Qwen3.6-35B-A3B, and Qwen3.8-Flash-Next. The post says these models can be run locally in one click, with Unsloth GGUFs supported.

Read the original x.com

Source: Daniel Han · x.comPublished · added here