End of training

README.md

@@ -0,0 +1,67 @@
+---
+license: cc-by-4.0
+base_model: vesteinn/DanskBERT
+tags:
+- generated_from_trainer
+model-index:
+- name: danskbert_NCS
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# danskbert_NCS
+
+This model is a fine-tuned version of [vesteinn/DanskBERT](https://huggingface.co/vesteinn/DanskBERT) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.4471
+- F1-score: 0.8063
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 16
+- eval_batch_size: 16
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 10
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | F1-score |
+|:-------------:|:-----:|:----:|:---------------:|:--------:|
+| 0.5221        | 1.0   | 504  | 0.4471          | 0.8063   |
+| 0.451         | 2.0   | 1008 | 0.4371          | 0.7900   |
+| 0.3498        | 3.0   | 1512 | 0.5378          | 0.7793   |
+| 0.2562        | 4.0   | 2016 | 0.6088          | 0.7923   |
+| 0.1938        | 5.0   | 2520 | 0.7844          | 0.7730   |
+| 0.1377        | 6.0   | 3024 | 1.3832          | 0.7426   |
+| 0.102         | 7.0   | 3528 | 1.3346          | 0.7686   |
+| 0.0758        | 8.0   | 4032 | 1.7920          | 0.7364   |
+| 0.0583        | 9.0   | 4536 | 1.6097          | 0.7691   |
+| 0.0446        | 10.0  | 5040 | 1.6403          | 0.7667   |
+
+
+### Framework versions
+
+- Transformers 4.41.2
+- Pytorch 2.3.0+cu121
+- Datasets 2.20.0
+- Tokenizers 0.19.1

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1a91a34add48e0c6c237d75f991064f8aa0313389da7a38cd94675b0e146af0b
+oid sha256:97034a1223287dbf85daec37fd30c769933d93b847991414e23f5b8071fbe0fe
 size 497814104

runs/Jul04_15-14-34_1bbe78489ae4/events.out.tfevents.1720106086.1bbe78489ae4.2583.2

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:00cbe3ac24389b95851a764bd5ca9cf910c8b879d59ee0f11665a44c11e1bf12
-size 9818
+oid sha256:5e510117e6f1713419efcdbee4493816ee402afef0348de1be34e3730746d9b7
+size 10706

runs/Jul04_15-14-34_1bbe78489ae4/events.out.tfevents.1720111422.1bbe78489ae4.2583.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:87a92c807864bd6088da0ffa1a9255bd23a02d5b2c1bdeaf55d291e0c2c2f7ef
+size 411