abarbosa's picture
Pushing fine-tuned model to Hugging Face Hub
e9d4334 verified
metadata
language:
  - pt
  - en
tags:
  - aes
datasets:
  - kamel-usp/aes_enem_dataset
base_model: TucanoBR/Tucano-2b4-Instruct
metrics:
  - accuracy
  - qwk
library_name: peft
model-index:
  - name: Tucano-2b4-Instruct-tucano_classification_lora-C2-essay_only-r16
    results:
      - task:
          type: text-classification
          name: Automated Essay Score
        dataset:
          name: Automated Essay Score ENEM Dataset
          type: kamel-usp/aes_enem_dataset
          config: JBCS2025
          split: test
        metrics:
          - name: Macro F1
            type: f1
            value: 0.1740295908491651
          - name: QWK
            type: qwk
            value: 0.2155774111675125
          - name: Weighted Macro F1
            type: f1
            value: 0.2208477006781353

Model ID: Tucano-2b4-Instruct-tucano_classification_lora-C2-essay_only-r16

Results

test_data
eval_accuracy 0.217391
eval_RMSE 70.6081
eval_QWK 0.215577
eval_Macro_F1 0.17403
eval_Weighted_F1 0.220848
eval_Micro_F1 0.217391
eval_HDIV 0.137681