lmsys
/

DeepSeek-V3-NextN

Model card Files Files and versions Community

ispobock commited on Mar 27

Commit

57afcff

·

verified ·

1 Parent(s): 91533a3

Update README.md

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -1,8 +1,8 @@
 # DeepSeek-V3-NextN
-NextN layer for DeepSeek-V3 (https://huggingface.co/deepseek-ai/DeepSeek-V3) model. Used for speculative decoding in SGLang (https://github.com/sgl-project/sglang).
 ## Usage
 ```
-python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-V3 --speculative-algo EAGLE --speculative-draft lmsys/DeepSeek-V3-NextN --speculative-num-steps 2 --speculat
-ive-eagle-topk 4 --speculative-num-draft-tokens 4 --trust-remote --tp 8
-```

 # DeepSeek-V3-NextN
+NextN layer exported for [deepseek-ai/DeepSeek-V3](https://huggingface.co/deepseek-ai/DeepSeek-V3) model with [script](https://github.com/sgl-project/sglang/blob/main/scripts/export_deepseek_nextn.py). Used for speculative decoding in [SGLang](https://github.com/sgl-project/sglang).
 ## Usage
 ```
+python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-V3 --speculative-algo EAGLE --speculative-draft lmsys/DeepSeek-V3-NextN --speculative-num-steps 2 --speculative-eagle-topk 4 --speculative-num-draft-tokens 4 --trust-remote --tp 8
+```