JLouisBiz
/

Qwen3-0.6B-GGUF-for-24GB-VRAM

Text Generation

Norwegian Bokmål

Norwegian Nynorsk

Eastern Yiddish

Simplified Chinese

Traditional Chinese

Levantine Arabic

Egyptian Arabic

Moroccan Arabic

Mesopotamian Arabic

Ta’izzi-Adeni Arabic

Tunisian Arabic

North Azerbaijani

Model card Files Files and versions

JLouisBiz commited on 3 days ago

Commit

7304f5c

·

verified ·

1 Parent(s): d896850

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -155,6 +155,8 @@ llama-server --jinja -m Qwen3-0.6B-Q8_0.gguf
 llama-server --jinja -fa -c 8192 -ngl 999 -v --log-timestamps --host 192.168.1.68 -m Qwen3-0.6B-Q8_0.gguf
 ```
 # Qwen3-0.6B
 <a href="https://chat.qwen.ai/" target="_blank" style="margin: 2px;">
     <img alt="Chat" src="https://img.shields.io/badge/%F0%9F%92%9C%EF%B8%8F%20Qwen%20Chat%20-536af5" style="display: inline-block; vertical-align: middle;"/>

 llama-server --jinja -fa -c 8192 -ngl 999 -v --log-timestamps --host 192.168.1.68 -m Qwen3-0.6B-Q8_0.gguf
 ```
+3. To disable thinking process, just add `/no_think` in the system message.
 # Qwen3-0.6B
 <a href="https://chat.qwen.ai/" target="_blank" style="margin: 2px;">
     <img alt="Chat" src="https://img.shields.io/badge/%F0%9F%92%9C%EF%B8%8F%20Qwen%20Chat%20-536af5" style="display: inline-block; vertical-align: middle;"/>