Hugging Face's logo

lapp0
/
gpt2_model_card_distily_test

TensorBoard
Safetensors
distily
gpt2
Generated from Trainer
8-bit precision
bitsandbytes
Model card Files Metrics Community
lapp0 commited on
Commit
1d58382
·
verified ·
1 Parent(s): 5427362

Training in progress, step 4995

Browse files
Files changed (8) hide show
  1. README.md +6 -6
  2. model.safetensors +1 -1
  3. runs/Aug05_19-39-30_232a0f8c3879/events.out.tfevents.1722886853.232a0f8c3879 +3 -0
  4. runs/Aug05_19-42-22_232a0f8c3879/events.out.tfevents.1722887023.232a0f8c3879 +3 -0
  5. runs/Aug05_20-05-35_232a0f8c3879/events.out.tfevents.1722888420.232a0f8c3879 +3 -0
  6. runs/Aug05_20-08-55_232a0f8c3879/events.out.tfevents.1722888621.232a0f8c3879 +3 -0
  7. runs/Aug05_20-15-30_232a0f8c3879/events.out.tfevents.1722889017.232a0f8c3879 +3 -0
  8. training_args.bin +2 -2
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 2420.8000
20
 
21
  ## Model description
22
 
@@ -47,11 +47,11 @@ The following hyperparameters were used during training:
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:------:|:----:|:---------------:|
50
- | No log | 0 | 0 | 13696.0 |
51
- | 2547.625 | 0.2002 | 2000 | 2748.8000 |
52
- | 1903.25 | 0.4004 | 4000 | 2572.8000 |
53
- | 2260.625 | 0.6006 | 6000 | 2444.8000 |
54
- | 1823.4062 | 0.8008 | 8000 | 2420.8000 |
55
 
56
 
57
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 2109.6001
20
 
21
  ## Model description
22
 
 
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:------:|:----:|:---------------:|
50
+ | No log | 0 | 0 | 13504.0 |
51
+ | 2552.5 | 0.2002 | 2000 | 2404.8000 |
52
+ | 1984.5 | 0.4004 | 4000 | 2262.3999 |
53
+ | 2222.25 | 0.6006 | 6000 | 2133.6001 |
54
+ | 2066.0 | 0.8008 | 8000 | 2109.6001 |
55
 
56
 
57
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1ed63ed9d628b22394cf9785f505bd1b355c58c35f7a6a22147919002241cce8
3
  size 248894656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cedb8683b62bb5707ba1760b30105224c4f64d30cb2fe96d63488f89009ce2d
3
  size 248894656
runs/Aug05_19-39-30_232a0f8c3879/events.out.tfevents.1722886853.232a0f8c3879 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:685d5cfd6e920bd95890d40654bedaf48a2361b51832373bcc89af1dab180637
3
+ size 6014
runs/Aug05_19-42-22_232a0f8c3879/events.out.tfevents.1722887023.232a0f8c3879 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61ed9a009545d5cc79ece31baa91e46cd58e023cf33f7e5c579d47604beb30de
3
+ size 6014
runs/Aug05_20-05-35_232a0f8c3879/events.out.tfevents.1722888420.232a0f8c3879 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f6712fbd52e1d80f4db9be3f30adadb5b3fcec30e2f789598732269f4315ca2
3
+ size 6014
runs/Aug05_20-08-55_232a0f8c3879/events.out.tfevents.1722888621.232a0f8c3879 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae0917d6ed6c48e5a1552642b0d3b6321d26fad8bdbb531dadf9c31b0fd9ae88
3
+ size 6014
runs/Aug05_20-15-30_232a0f8c3879/events.out.tfevents.1722889017.232a0f8c3879 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:654e8c2a6a279d59604a1173c08d2881f184603fe6078f334d1436e190327f3b
3
+ size 73388
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d732488cbe1f4b6de1bcc03c3d7053db81c5deaaecec7d0c3d6dc5096e6964f9
3
- size 907106564
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60e4f7d8ff5f06f8e95ce47496af4b3464efbb92f372dc5b72a41ccc9ece0588
3
+ size 907106628