kdhole commited on
Commit
1fb082f
·
verified ·
1 Parent(s): 6470518

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -3
README.md CHANGED
@@ -8,14 +8,23 @@ base_model:
8
  - meta-llama/Llama-3.1-8B
9
  ---
10
 
11
- This is the tuned lens version of LLama 3.1 8B (i.e. all the layers of the model have been trained to minimize the KL divergence with the last layer).
12
 
13
  ```bash
14
  pip install tuned-lens
15
  ```
16
  ```bash
17
- python -m tuned_lens train --model.name meta-llama/Llama-3.1-8B --data.name bookcorpus/bookcorpus --per_gpu_batch_size=1 --output my_lenses/meta-llama/Llama-3.1-8B
 
 
 
 
18
  ```
19
  ```bash
20
- python -m tuned_lens eval --data.name bookcorpus/bookcorpus --model.name meta-llama/Llama-3.1-8B --tokens 16400000 --lens_name my_lenses/meta-llama/Llama-3.1-8B --output evaluation/meta-llama/Llama-3.1-8B
 
 
 
 
 
21
  ```
 
8
  - meta-llama/Llama-3.1-8B
9
  ---
10
 
11
+ This is the tuned lens version of LLama 3.1 8B (i.e. all the layers of the model have been trained to minimize the KL divergence with the last layer).
12
 
13
  ```bash
14
  pip install tuned-lens
15
  ```
16
  ```bash
17
+ python -m tuned_lens train \
18
+ --model.name meta-llama/Llama-3.1-8B \
19
+ --data.name bookcorpus/bookcorpus \
20
+ --per_gpu_batch_size=1 \
21
+ --output my_lenses/meta-llama/Llama-3.1-8B
22
  ```
23
  ```bash
24
+ python -m tuned_lens eval \
25
+ --data.name bookcorpus/bookcorpus \
26
+ --model.name meta-llama/Llama-3.1-8B \
27
+ --tokens 16400000 \
28
+ --lens_name my_lenses/meta-llama/Llama-3.1-8B \
29
+ --output evaluation/meta-llama/Llama-3.1-8B
30
  ```