trainer_wheel_2.0

This model is a fine-tuned version of google/flan-t5-large on the None dataset. It achieves the following results on the evaluation set:

• Loss: 2.2068
• Refined F1: 12.9129
• Meteor: 19.9212
• Bert Score F1: 83.2043
• Rouge1: 22.3927
• Rouge2: 8.2360
• Rougel: 18.2793

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• gradient_accumulation_steps: 2
• total_train_batch_size: 16
• optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• num_epochs: 2

Training results

Training Loss	Epoch	Step	Validation Loss	Refined F1	Meteor	Bert Score F1	Rouge1	Rouge2	Rougel
2.4429	1.0	2797	2.2296	12.5911	19.2809	82.8943	21.4421	7.7851	17.6693
2.3284	1.9995	5592	2.2068	12.9129	19.9212	83.2043	22.3927	8.2360	18.2793

Framework versions

• Transformers 4.49.0
• Pytorch 2.5.1+cu124
• Datasets 3.3.1
• Tokenizers 0.21.0