ispobock commited on
Commit
1e947da
·
verified ·
1 Parent(s): 972fa49

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -1,8 +1,7 @@
1
  # DeepSeek-R1-NextN
2
- NextN layer for DeepSeek-R1 (https://huggingface.co/deepseek-ai/DeepSeek-R1) model. Used for speculative decoding in SGLang (https://github.com/sgl-project/sglang).
3
 
4
  ## Usage
5
  ```
6
- python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-R1 --speculative-algo EAGLE --speculative-draft lmsys/DeepSeek-R1-NextN --speculative-num-steps 2 --speculat
7
- ive-eagle-topk 4 --speculative-num-draft-tokens 4 --trust-remote --tp 8
8
  ```
 
1
  # DeepSeek-R1-NextN
2
+ NextN layer exported from [deepseek-ai/DeepSeek-R1](https://huggingface.co/deepseek-ai/DeepSeek-R1) model with [script](https://github.com/sgl-project/sglang/blob/main/scripts/export_deepseek_nextn.py). Used for speculative decoding in [SGLang](https://github.com/sgl-project/sglang).
3
 
4
  ## Usage
5
  ```
6
+ python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-R1 --speculative-algo EAGLE --speculative-draft lmsys/DeepSeek-R1-NextN --speculative-num-steps 2 --speculative-eagle-topk 4 --speculative-num-draft-tokens 4 --trust-remote --tp 8
 
7
  ```