Model save

README.md

@@ -1,4 +1,5 @@
 ---
+base_model: dmis-lab/biobert-base-cased-v1.1
 tags:
 - generated_from_trainer
 model-index:
@@ -11,9 +12,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 # ontochem_biobert_half
 
-This model was trained from scratch on an unknown dataset.
+This model is a fine-tuned version of [dmis-lab/biobert-base-cased-v1.1](https://huggingface.co/dmis-lab/biobert-base-cased-v1.1) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0716
+- Loss: 0.0715
 
 ## Model description
 
@@ -39,22 +40,26 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_steps: 500
-- num_epochs: 10
+- num_epochs: 14
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| No log        | 1.0   | 24   | 0.0693          |
-| No log        | 2.0   | 48   | 0.0688          |
-| No log        | 3.0   | 72   | 0.0674          |
-| No log        | 4.0   | 96   | 0.0669          |
-| No log        | 5.0   | 120  | 0.0688          |
-| No log        | 6.0   | 144  | 0.0669          |
-| No log        | 7.0   | 168  | 0.0706          |
-| No log        | 8.0   | 192  | 0.0688          |
-| No log        | 9.0   | 216  | 0.0735          |
-| No log        | 10.0  | 240  | 0.0716          |
+| No log        | 1.0   | 24   | 1.1381          |
+| No log        | 2.0   | 48   | 1.0216          |
+| No log        | 3.0   | 72   | 0.8319          |
+| No log        | 4.0   | 96   | 0.5484          |
+| No log        | 5.0   | 120  | 0.1999          |
+| No log        | 6.0   | 144  | 0.1298          |
+| No log        | 7.0   | 168  | 0.1059          |
+| No log        | 8.0   | 192  | 0.0866          |
+| No log        | 9.0   | 216  | 0.0749          |
+| No log        | 10.0  | 240  | 0.0695          |
+| No log        | 11.0  | 264  | 0.0684          |
+| No log        | 12.0  | 288  | 0.0696          |
+| No log        | 13.0  | 312  | 0.0741          |
+| No log        | 14.0  | 336  | 0.0715          |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4cf4965b4cbb19b118b8d7657f69e5fbc7c0c6c6ba037a99e5aca3860ea77f8c
+oid sha256:d1e8acd595d42928b6c402d5bb906f73d2cc8c04831bf691bcb08f3458f122c1
 size 430911284