Hugging Face's logo

Keven16
/
Qwen2.5-32B-Tag

Safetensors
alignment-handbook
Generated from Trainer
Model card Files Community
Keven16 commited on
Commit
42a84be
·
1 Parent(s): 9c77fec

add model

Browse files
Files changed (29) hide show
  1. .gitattributes +1 -0
  2. README.md +60 -3
  3. added_tokens.json +3 -0
  4. all_results.json +3 -0
  5. config.json +3 -0
  6. generation_config.json +3 -0
  7. merges.txt +0 -0
  8. model-00001-of-00014.safetensors +3 -0
  9. model-00002-of-00014.safetensors +3 -0
  10. model-00003-of-00014.safetensors +3 -0
  11. model-00004-of-00014.safetensors +3 -0
  12. model-00005-of-00014.safetensors +3 -0
  13. model-00006-of-00014.safetensors +3 -0
  14. model-00007-of-00014.safetensors +3 -0
  15. model-00008-of-00014.safetensors +3 -0
  16. model-00009-of-00014.safetensors +3 -0
  17. model-00010-of-00014.safetensors +3 -0
  18. model-00011-of-00014.safetensors +3 -0
  19. model-00012-of-00014.safetensors +3 -0
  20. model-00013-of-00014.safetensors +3 -0
  21. model-00014-of-00014.safetensors +3 -0
  22. model.safetensors.index.json +3 -0
  23. special_tokens_map.json +3 -0
  24. tokenizer.json +3 -0
  25. tokenizer_config.json +3 -0
  26. train_results.json +3 -0
  27. trainer_state.json +3 -0
  28. training_args.bin +3 -0
  29. vocab.json +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.json filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,60 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: /data/wenkaiyang/hf_models/Qwen2.5-32B-Instruct
3
+ tags:
4
+ - alignment-handbook
5
+ - generated_from_trainer
6
+ datasets:
7
+ - /home/shumma/yangwenkai/NuminaMath-Processed/qwq/processed_sft_data/seed_subset_1w_300sep_tagged
8
+ model-index:
9
+ - name: qwq_numina_processed_seed_subset_1w_300sep_tagged_sft_lr_1e-5
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # qwq_numina_processed_seed_subset_1w_300sep_tagged_sft_lr_1e-5
17
+
18
+ This model is a fine-tuned version of [/data/wenkaiyang/hf_models/Qwen2.5-32B-Instruct](https://huggingface.co//data/wenkaiyang/hf_models/Qwen2.5-32B-Instruct) on the /home/shumma/yangwenkai/NuminaMath-Processed/qwq/processed_sft_data/seed_subset_1w_300sep_tagged dataset.
19
+
20
+ ## Model description
21
+
22
+ More information needed
23
+
24
+ ## Intended uses & limitations
25
+
26
+ More information needed
27
+
28
+ ## Training and evaluation data
29
+
30
+ More information needed
31
+
32
+ ## Training procedure
33
+
34
+ ### Training hyperparameters
35
+
36
+ The following hyperparameters were used during training:
37
+ - learning_rate: 1e-05
38
+ - train_batch_size: 1
39
+ - eval_batch_size: 8
40
+ - seed: 42
41
+ - distributed_type: multi-GPU
42
+ - num_devices: 4
43
+ - gradient_accumulation_steps: 8
44
+ - total_train_batch_size: 32
45
+ - total_eval_batch_size: 32
46
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
+ - lr_scheduler_type: cosine
48
+ - lr_scheduler_warmup_ratio: 0.1
49
+ - num_epochs: 3
50
+
51
+ ### Training results
52
+
53
+
54
+
55
+ ### Framework versions
56
+
57
+ - Transformers 4.43.4
58
+ - Pytorch 2.4.0+cu121
59
+ - Datasets 2.21.0
60
+ - Tokenizers 0.19.1
added_tokens.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58b54bbe36fc752f79a24a271ef66a0a0830054b4dfad94bde757d851968060b
3
+ size 605
all_results.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96f40a2d51fb025c635985e53b71f328d4c3b220dc2c3021c727c215f9548015
3
+ size 232
config.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4db70e6ced2635668f14114dd0ffebcf6591cd688d91ba78dd0eac3139a7b27
3
+ size 731
generation_config.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b82f9bfbe799289189dcf5abded9fa233489d0b93a55bc8cc2865267d521b275
3
+ size 243
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
model-00001-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b65c0eac33034b59a8b5a1d2010597fd82cc334139c9bd1228da773d28a5f728
3
+ size 4891730992
model-00002-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:477c28622970a1d0ab63fb624c8a77fe8e68d6cd304741a26127d17758919130
3
+ size 4876059352
model-00003-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c129fca7e33c2387b7933910c15f93140d750911e4cf929741c55462381501d1
3
+ size 4876059384
model-00004-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4ef2ce4f9d43b46c5e15168fcd3dfceed4691083fea5b0b4f90afcc0f0b91e7
3
+ size 4876059416
model-00005-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc049b0415549c29e1555331b72a08e76395059ccd5e06ea7ba93ece2a5c632f
3
+ size 4876059416
model-00006-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:915891bfe5cbbec8060a61c1df77dcc00d4ad6013ad0637fa1f677d1c74c2dd1
3
+ size 4876059416
model-00007-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4919d9fb871753784fdd6e5eb5e992c91bc0acd2e8e2e4575b38667950a5dadc
3
+ size 4876059416
model-00008-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5217cf3c7050a6d822e8887d74da833d60e0c1ec4fc2e803f2ba59f4eab7a8af
3
+ size 4876059416
model-00009-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:259c10b92a8fa0b1ed32d7b3023a3e149d0042109fde3788b06029d4a7faf1dc
3
+ size 4876059416
model-00010-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07a8b1986f7ab13db203bb421c7b62c5b1313b44a3ec1d0530798d94e349eef9
3
+ size 4876059416
model-00011-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98ce8dde90cf7819e453a6db54f40f5db2d943713377715dcf568a1a16ffcc1e
3
+ size 4876059416
model-00012-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65c2fec43f89d4ea199264800ad53615a124234839ec961e05da4b11c5b011cf
3
+ size 4876059416
model-00013-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:450fa9c8ab87dd3d16ad003d615d09d552394c83f1a9a2e34b3a22a549d49730
3
+ size 4876059416
model-00014-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22a6decd1d492bcecff52df73aaaaea46852723da4208af261762b545b924054
3
+ size 2123397800
model.safetensors.index.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6548816f7ae8cd9fc353a20737f640ad32db6eff13a8c097246084c3207300f
3
+ size 63248
special_tokens_map.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd
3
+ size 613
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:195da972acf0e279b362e440852fe2941d4d027323096e79782e56379748a782
3
+ size 7031772
tokenizer_config.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50b8c2601584ecae7028d594675859a6a6c66a5b702180cb584e3b7c5715cd4c
3
+ size 5142
train_results.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96f40a2d51fb025c635985e53b71f328d4c3b220dc2c3021c727c215f9548015
3
+ size 232
trainer_state.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1ac976377ddd4d12d14424d0c7ac85c11faf661972dab265e47b59eb2f73f09e
3
+ size 64622
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3423def5f73eba627a9cd14d40e80fe961bc89504fbbecd4bb7753772277f43d
3
+ size 6968
vocab.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910
3
+ size 2776833