Update README.md

README.md

@@ -6,18 +6,24 @@ pipeline_tag: text-generation
 base_model:
 - Qwen/Qwen3-30B-A3B-Thinking-2507
 ---
-# Qwen3-30B-A3B-Thinking-2507-AWQ
+# Qwen3-30B-A3B-Thinking-2507-AWQ-4bit
 
 ## Method
-Quantised using [vllm-project/llm-compressor](https://github.com/vllm-project/llm-compressor.git), [nvidia/Llama-Nemotron-Post-Training-Dataset](https://huggingface.co/datasets/nvidia/Llama-Nemotron-Post-Training-Dataset) and the following configs:
+[vllm-project/llm-compressor](https://github.com/vllm-project/llm-compressor.git) and [nvidia/Llama-Nemotron-Post-Training-Dataset](https://huggingface.co/datasets/nvidia/Llama-Nemotron-Post-Training-Dataset) were used to quantize the original model. For further quantization arguments and configurations information, please visit [config.json](https://huggingface.co/cpatonn/Qwen3-30B-A3B-Thinking-2507-AWQ-4bit/blob/main/config.json) and [recipe.yaml](https://huggingface.co/cpatonn/Qwen3-30B-A3B-Thinking-2507-AWQ-4bit/blob/main/recipe.yaml).
+
+## Inference
+Please install the latest vllm releases for better support:
 ```
-recipe = [
-    AWQModifier(
-        ignore=["lm_head", "re:.*mlp.gate$", "re:.*mlp.shared_expert_gate$"],
-        scheme="W4A16",
-        targets=["Linear"],
-    ),
-]
+pip install -U vllm
+```
+
+Qwen3-30B-A3B-Thinking-2507-AWQ-4bit example usage:
+```
+vllm serve cpatonn/Qwen3-30B-A3B-Thinking-2507-AWQ-4bit \
+    --dtype float16 \
+    --tensor-parallel-size 4  \
+    --enable-auto-tool-choice \
+    --tool-call-parser hermes
 ```
 
 # Qwen3-30B-A3B-Thinking-2507