WideMan commited on
Commit
6777a2f
·
verified ·
1 Parent(s): 6d54fd4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -18
README.md CHANGED
@@ -15,8 +15,7 @@ base-model: yhavinga/gpt2-medium-dutch
15
  This model is a fine-tuned version of [yhavinga/gpt2-medium-dutch](https://huggingface.co/yhavinga/gpt2-medium-dutch) on [GroNLP/dutch-cola](https://huggingface.co/datasets/GroNLP/dutch-cola).
16
  It achieves the following results on the evaluation set:
17
 
18
- - Loss: 0.519
19
- - Accuracy: 0.7613
20
 
21
 
22
  ## Training Details
@@ -30,19 +29,5 @@ The following hyperparameters were used during training:
30
  - train_batch_size: 16
31
  - eval_batch_size: 16
32
  - seed: 42
33
- - optimizer: AdamW with lr=4e-05, weight_decay=0.01, betas=(o.9, 0.999) and epsilon=1e-08
34
- - num_epochs=3
35
- - fp16=True
36
- - gradient_acc_step=1
37
-
38
-
39
-
40
- ## Evaluation
41
-
42
- ### Training results
43
-
44
- | Training Loss | Epoch | Step | Validation Loss | Accuracy |
45
- |:-------------:|:-----:|:----:|:---------------:|:--------:|
46
- | 0.5648 | 1.0 | 1244 | 0.5695 | 0.7192 |
47
- | 0.3399 | 2.0 | 2488 | 0.5190 | 0.7613 |
48
- | 0.1779 | 3.0 | 3732 | 0.7269 | 0.7625 |
 
15
  This model is a fine-tuned version of [yhavinga/gpt2-medium-dutch](https://huggingface.co/yhavinga/gpt2-medium-dutch) on [GroNLP/dutch-cola](https://huggingface.co/datasets/GroNLP/dutch-cola).
16
  It achieves the following results on the evaluation set:
17
 
18
+ - Accuracy: 0.7992
 
19
 
20
 
21
  ## Training Details
 
29
  - train_batch_size: 16
30
  - eval_batch_size: 16
31
  - seed: 42
32
+ - num_epochs=2
33
+ - FP16=True