sudeshna84 commited on
Commit
3ece1c5
·
verified ·
1 Parent(s): c402180

Model save

Browse files
Files changed (1) hide show
  1. README.md +12 -12
README.md CHANGED
@@ -17,7 +17,7 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [unsloth/tinyllama-chat-bnb-4bit](https://huggingface.co/unsloth/tinyllama-chat-bnb-4bit) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 6.6828
21
 
22
  ## Model description
23
 
@@ -52,22 +52,22 @@ The following hyperparameters were used during training:
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:------:|:----:|:---------------:|
55
- | 12.7183 | 0.9906 | 92 | 8.6482 |
56
- | 4.2189 | 1.9906 | 184 | 7.2366 |
57
- | 4.0268 | 2.9906 | 276 | 7.0228 |
58
- | 3.9909 | 3.9906 | 368 | 6.8973 |
59
- | 3.9984 | 4.9906 | 460 | 6.8145 |
60
- | 3.9857 | 5.9906 | 552 | 6.7709 |
61
- | 4.0381 | 6.9906 | 644 | 6.7312 |
62
- | 3.973 | 7.9906 | 736 | 6.7040 |
63
- | 3.9501 | 8.9906 | 828 | 6.6876 |
64
- | 3.9546 | 9.9906 | 920 | 6.6828 |
65
 
66
 
67
  ### Framework versions
68
 
69
  - PEFT 0.14.0
70
  - Transformers 4.48.3
71
- - Pytorch 2.6.0+cu124
72
  - Datasets 3.3.0
73
  - Tokenizers 0.21.0
 
17
 
18
  This model is a fine-tuned version of [unsloth/tinyllama-chat-bnb-4bit](https://huggingface.co/unsloth/tinyllama-chat-bnb-4bit) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 9.0804
21
 
22
  ## Model description
23
 
 
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:------:|:----:|:---------------:|
55
+ | 10.0309 | 0.9906 | 92 | 9.5557 |
56
+ | 3.9824 | 1.9906 | 184 | 9.3047 |
57
+ | 3.9119 | 2.9906 | 276 | 9.2470 |
58
+ | 3.8886 | 3.9906 | 368 | 9.1900 |
59
+ | 3.8639 | 4.9906 | 460 | 9.1643 |
60
+ | 3.8628 | 5.9906 | 552 | 9.1318 |
61
+ | 3.9097 | 6.9906 | 644 | 9.1108 |
62
+ | 3.8363 | 7.9906 | 736 | 9.0947 |
63
+ | 3.8156 | 8.9906 | 828 | 9.0838 |
64
+ | 3.8048 | 9.9906 | 920 | 9.0804 |
65
 
66
 
67
  ### Framework versions
68
 
69
  - PEFT 0.14.0
70
  - Transformers 4.48.3
71
+ - Pytorch 2.5.1+cu121
72
  - Datasets 3.3.0
73
  - Tokenizers 0.21.0