olegshulyakov/DeepSeek-R1-0528-Qwen3-8B-GGUF

DeepSeek-R1-0528-Qwen3-8B

Model creator: deepseek-ai
Original model: deepseek-ai/DeepSeek-R1-0528-Qwen3-8B
GGUF quantization: provided by olegshulyakov using llama.cpp

Special thanks

🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

Use with Ollama

ollama run "hf.co/olegshulyakov/DeepSeek-R1-0528-Qwen3-8B-GGUF:<quantization>"

Use with LM Studio

lms load "olegshulyakov/DeepSeek-R1-0528-Qwen3-8B-GGUF"

Use with llama.cpp CLI

llama-cli --hf-repo "olegshulyakov/DeepSeek-R1-0528-Qwen3-8B-GGUF" --hf-file "DeepSeek-R1-0528-Qwen3-8B-Q5_K_M.gguf" -p "The meaning to life and the universe is"

Use with llama.cpp Server:

llama-server --hf-repo "olegshulyakov/DeepSeek-R1-0528-Qwen3-8B-GGUF" --hf-file "DeepSeek-R1-0528-Qwen3-8B-Q5_K_M.gguf" -c 4096