Update README.md

README.md

@@ -23,6 +23,9 @@ This repo contains the FP8 version of **Qwen3-1.7B**, which has the following fe
 
 For more details, including benchmark evaluation, hardware requirements, and inference performance, please refer to our [blog](https://qwenlm.github.io/blog/qwen3/), [GitHub](https://github.com/QwenLM/Qwen3), and [Documentation](https://qwen.readthedocs.io/en/latest/).
 
+> [!TIP]
+> If you encounter significant endless repetitions, please refer to the [Best Practices](#best-practices) section for optimal sampling parameters, and set the ``presence_penalty`` to 1.5.
+
 ## Quickstart
 
 The code of Qwen3 has been in the latest Hugging Face `transformers` and we advise you to use the latest version of `transformers`.
@@ -80,16 +83,18 @@ print("thinking content:", thinking_content)
 print("content:", content)
 ```
 
-For deployment, you can use `vllm>=0.8.5` or `sglang>=0.4.5.post2` to create an OpenAI-compatible API endpoint:
-- vLLM:
+For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.4` or  to create an OpenAI-compatible API endpoint:
+- SGLang:
     ```shell
-    vllm serve Qwen/Qwen3-1.7B-FP8 --enable-reasoning --reasoning-parser deepseek_r1
+    python -m sglang.launch_server --model-path Qwen/Qwen3-1.7B-FP8 --reasoning-parser qwen3
     ```
-- SGLang:
+- vLLM:
     ```shell
-    python -m sglang.launch_server --model-path Qwen/Qwen3-1.7B-FP8 --reasoning-parser deepseek-r1
+    vllm serve Qwen/Qwen3-1.7B-FP8 --enable-reasoning --reasoning-parser deepseek_r1
     ```
 
+For local use, applications such as llama.cpp, Ollama, LMStudio, and MLX-LM have also supported Qwen3.
+
 ## Note on FP8
 
 For convenience and performance, we have provided `fp8`-quantized model checkpoint for Qwen3, whose name ends with `-FP8`. The quantization method is fine-grained `fp8` quantization with block size of 128. You can find more details in the `quantization_config` field in `config.json`.
@@ -125,8 +130,8 @@ However, please pay attention to the following known issues:
 ## Switching Between Thinking and Non-Thinking Mode
 
 > [!TIP]
-> The `enable_thinking` switch is also available in APIs created by vLLM and SGLang. 
-> Please refer to [our documentation](https://qwen.readthedocs.io/) for more details.
+> The `enable_thinking` switch is also available in APIs created by SGLang and vLLM. 
+> Please refer to our documentation for [SGLang](https://qwen.readthedocs.io/en/latest/deployment/sglang.html#thinking-non-thinking-modes) and [vLLM](https://qwen.readthedocs.io/en/latest/deployment/vllm.html#thinking-non-thinking-modes) users.
 
 ### `enable_thinking=True`