smaximo commited on
Commit
054564a
·
1 Parent(s): af05291

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +46 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: es
3
+ datasets:
4
+ - squad_es
5
+ - hackathon-pln-es/biomed_squad_es_v2
6
+ metrics:
7
+ - "f1"
8
+
9
+ ---
10
+
11
+ # roberta-base-biomedical-clinical-es for QA
12
+ This model is a fine-tuned version of [PlanTL-GOB-ES/roberta-base-biomedical-es](https://huggingface.co/PlanTL-GOB-ES/roberta-base-biomedical-es) on the [squad_es (v2)](https://huggingface.co/datasets/squad_es) training dataset.
13
+
14
+
15
+ ## Hyperparameters
16
+
17
+ The hyperparameters were chosen based on those used in [PlanTL-GOB-ES/roberta-base-bne-sqac](https://huggingface.co/PlanTL-GOB-ES/roberta-base-bne-sqac), a spanish-based QA model trained on a dataset with SQUAD v1 fromat.
18
+
19
+ ```
20
+ --num_train_epochs 2
21
+ --learning_rate 3e-5
22
+ --weight_decay 0.01
23
+ --max_seq_length 386
24
+ --doc_stride 128
25
+ ```
26
+
27
+ ## Performance
28
+
29
+ Evaluated on the [hackathon-pln-es/biomed_squad_es_v2](https://huggingface.co/datasets/hackathon-pln-es/biomed_squad_es_v2) dev set.
30
+
31
+ ```
32
+ eval_exact = 66.8426
33
+ eval_f1 = 75.2346
34
+
35
+ eval_HasAns_exact = 53.0249
36
+ eval_HasAns_f1 = 70.0031
37
+ eval_HasAns_total = 562
38
+ eval_NoAns_exact = 80.3478
39
+ eval_NoAns_f1 = 80.3478
40
+ eval_NoAns_total = 575
41
+
42
+ ```
43
+
44
+ ## Team
45
+
46
+ Santiago Maximo: [smaximo](https://huggingface.co/smaximo)