metadata
language:
- pt
- en
tags:
- aes
datasets:
- kamel-usp/aes_enem_dataset
base_model: TucanoBR/Tucano-2b4-Instruct
metrics:
- accuracy
- qwk
library_name: peft
model-index:
- name: Tucano-2b4-Instruct-tucano_classification_lora-C4-essay_only-r16
results:
- task:
type: text-classification
name: Automated Essay Score
dataset:
name: Automated Essay Score ENEM Dataset
type: kamel-usp/aes_enem_dataset
config: JBCS2025
split: test
metrics:
- name: Macro F1
type: f1
value: 0.3852215938786416
- name: QWK
type: qwk
value: 0.5011415525114156
- name: Weighted Macro F1
type: f1
value: 0.5766245975192557
Model ID: Tucano-2b4-Instruct-tucano_classification_lora-C4-essay_only-r16
Results
test_data | |
---|---|
eval_accuracy | 0.572464 |
eval_RMSE | 29.6843 |
eval_QWK | 0.501142 |
eval_Macro_F1 | 0.385222 |
eval_Weighted_F1 | 0.576625 |
eval_Micro_F1 | 0.572464 |
eval_HDIV | 0.00724638 |