Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,13 @@
|
|
1 |
-
---
|
2 |
-
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
datasets:
|
3 |
+
- cerebras/SlimPajama-627B
|
4 |
+
base_model:
|
5 |
+
- Qwen/Qwen2-7B-Instruct
|
6 |
+
- yuhuili/EAGLE-Qwen2-7B-Instruct
|
7 |
+
---
|
8 |
+
|
9 |
+
Token frequency statistics based on [SlimPajama-627B](https://huggingface.co/datasets/cerebras/SlimPajama-627B), used for FR-Spec (https://arxiv.org/abs/2502.14856), see more at https://github.com/thunlp/FR-Spec.
|
10 |
+
|
11 |
+
freq_32768.pt can be loaded by torch.load(), and it is a list of high-frequency tokens.
|
12 |
+
|
13 |
+
config.json and pytorch_model.bin are the same as https://huggingface.co/yuhuili/EAGLE-Qwen2-7B-Instruct, and can be downloaded from their repo.
|