Decision models now run on device in llama.cpp. Free, fast, private! llama serve -hf ggml-org/Kev-4B-GGUF
Original titleDecision models now run on device in llama.cpp. Free, fast, private!
Read the original x.comSource: Clément Delangue · x.com
Decision models now run on device in llama.cpp. Free, fast, private! llama serve -hf ggml-org/Kev-4B-GGUF