Hermes adds local backend supporting Unsloth GGUF quantized models
Original titleHermes now has a local backend!
AISummary
Hermes now includes a local backend that runs Unsloth UD-Q4_K_XL and UD-Q4_K_M quants for DeepSeek-V4-Flash, Qwen3.8-27B, Qwen3.6-35B-A3B, and Qwen3.8-Flash-Next. The post says these models can be run locally in one click, with Unsloth GGUFs supported.
Source: Daniel Han · x.comPublished · added here