Hugging Face's logo

unsloth
/
QwQ-32B-GGUF

Text Generation
GGUF
English
qwen2
chat
qwen
Inference Endpoints
conversational
Model card Files Community
7
danielhanchen commited on
Commit
7a5f915
·
verified ·
1 Parent(s): 2c90caa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -34,7 +34,9 @@ tags:
34
  <h1 style="margin-top: 0rem;">Finetune your own Reasoning model like R1 with Unsloth!</h2>
35
  </div>
36
 
37
- To run this model, try:
 
 
38
  ```python
39
  import os
40
  os.environ["HF_HUB_ENABLE_HF_TRANSFER"] = "1"
 
34
  <h1 style="margin-top: 0rem;">Finetune your own Reasoning model like R1 with Unsloth!</h2>
35
  </div>
36
 
37
+ For Ollama: `ollama run hf.co/unsloth/QwQ-32B-GGUF:Q4_K_M`
38
+
39
+ For llama.cpp:
40
  ```python
41
  import os
42
  os.environ["HF_HUB_ENABLE_HF_TRANSFER"] = "1"