mobilenetv2-typecoffee-4

This model is a fine-tuned version of google/mobilenet_v2_1.0_224 on the Master-Rapha7/TypeCoffee_64x64 dataset. It achieves the following results on the evaluation set:

• Loss: 0.5280
• Accuracy: 0.8581
• Precision: 0.8602
• Recall: 0.8599
• F1: 0.8583
• Precision Durariadorio 64x64: 0.7963
• Recall Durariadorio 64x64: 0.8958
• F1 Durariadorio 64x64: 0.8431
• Precision Mole 64x64: 0.9385
• Recall Mole 64x64: 0.8472
• F1 Mole 64x64: 0.8905
• Precision Quebrado 64x64: 0.8671
• Recall Quebrado 64x64: 0.8611
• F1 Quebrado 64x64: 0.8641
• Precision Riadorio 64x64: 0.8029
• Recall Riadorio 64x64: 0.7237
• F1 Riadorio 64x64: 0.7612
• Precision Riofechado 64x64: 0.8961
• Recall Riofechado 64x64: 0.9718
• F1 Riofechado 64x64: 0.9324

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• num_epochs: 150.0

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy	Precision	Recall	F1	Precision Durariadorio 64x64	Recall Durariadorio 64x64	F1 Durariadorio 64x64	Precision Mole 64x64	Recall Mole 64x64	F1 Mole 64x64	Precision Quebrado 64x64	Recall Quebrado 64x64	F1 Quebrado 64x64	Precision Riadorio 64x64	Recall Riadorio 64x64	F1 Riadorio 64x64	Precision Riofechado 64x64	Recall Riofechado 64x64	F1 Riofechado 64x64
1.1481	1.0	364	1.3938	0.3609	0.4758	0.3633	0.3250	0.3093	0.2083	0.2490	0.2604	0.8264	0.3960	0.7391	0.5903	0.6564	0.3429	0.0789	0.1283	0.7273	0.1127	0.1951
1.0723	2.0	728	1.1584	0.5399	0.6226	0.5421	0.5264	0.4620	0.5486	0.5016	0.6638	0.5347	0.5923	0.9070	0.2708	0.4171	0.6321	0.4408	0.5194	0.4483	0.9155	0.6019
0.7898	3.0	1092	0.6299	0.7741	0.8007	0.7769	0.7725	0.5853	0.8819	0.7036	0.88	0.6111	0.7213	0.8314	0.9931	0.9051	0.7615	0.5461	0.6360	0.9453	0.8521	0.8963
0.7548	4.0	1456	0.5709	0.8003	0.8014	0.8040	0.7931	0.7044	0.7778	0.7393	0.7815	0.8194	0.8	0.8402	0.9861	0.9073	0.8172	0.5	0.6204	0.8636	0.9366	0.8986
0.9531	5.0	1820	2.1597	0.4559	0.5832	0.4511	0.4305	0.5	0.3819	0.4331	0.4241	0.5625	0.4836	0.9667	0.2014	0.3333	0.3810	0.8421	0.5246	0.6441	0.2676	0.3781
0.5557	6.0	2184	0.7730	0.7052	0.7442	0.7074	0.6834	0.9130	0.2917	0.4421	0.5650	0.875	0.6866	0.7598	0.9444	0.8421	0.6829	0.5526	0.6109	0.8	0.8732	0.8350
0.6538	7.0	2548	1.9892	0.4408	0.6329	0.4432	0.3945	0.3541	0.9097	0.5097	0.4204	0.6597	0.5135	1.0	0.0972	0.1772	0.7143	0.1974	0.3093	0.6757	0.3521	0.4630
0.6547	8.0	2912	0.8791	0.7534	0.7689	0.7552	0.7392	0.8116	0.3889	0.5258	0.8686	0.8264	0.8470	0.8103	0.9792	0.8868	0.7206	0.6447	0.6806	0.6333	0.9366	0.7557
0.6081	9.0	3276	0.9145	0.7204	0.7610	0.7211	0.7197	0.8	0.5	0.6154	0.9160	0.7569	0.8289	0.5902	1.0	0.7423	0.6149	0.6513	0.6326	0.8839	0.6972	0.7795
0.4939	10.0	3640	1.0787	0.6763	0.7720	0.6816	0.6545	0.9344	0.3958	0.5561	0.4764	0.9792	0.6409	0.8889	0.7778	0.8296	0.84	0.2763	0.4158	0.7202	0.9789	0.8299
0.5342	11.0	4004	1.0320	0.7052	0.7919	0.7079	0.6955	0.4844	0.9722	0.6467	0.9423	0.3403	0.5	0.8777	0.8472	0.8622	0.8652	0.5066	0.6390	0.7898	0.8732	0.8294
0.4245	12.0	4368	1.6048	0.6391	0.7139	0.6422	0.6172	0.8125	0.2708	0.4062	0.8763	0.5903	0.7054	0.675	0.9375	0.7849	0.7283	0.4408	0.5492	0.4775	0.9718	0.6404
0.47	13.0	4732	1.3465	0.6570	0.7300	0.6616	0.6355	0.5789	0.7639	0.6587	0.9636	0.3681	0.5327	0.8165	0.8958	0.8543	0.7656	0.3224	0.4537	0.5251	0.9577	0.6783
0.3446	14.0	5096	1.4362	0.6116	0.7217	0.6087	0.6093	0.8315	0.5139	0.6352	0.8333	0.7292	0.7778	0.9574	0.3125	0.4712	0.4328	0.8684	0.5777	0.5535	0.6197	0.5847
0.5964	15.0	5460	0.7144	0.7617	0.7975	0.7626	0.7612	0.6280	0.9028	0.7407	0.7065	0.9028	0.7927	0.8810	0.7708	0.8222	0.7951	0.6382	0.7080	0.9770	0.5986	0.7424
0.4593	16.0	5824	0.8750	0.7672	0.7855	0.7698	0.7641	0.8584	0.6736	0.7549	0.7665	0.8889	0.8232	0.8168	0.7431	0.7782	0.8318	0.5855	0.6873	0.6538	0.9577	0.7771
0.4267	17.0	6188	0.7799	0.7534	0.8171	0.7525	0.7514	0.9275	0.4444	0.6009	0.9902	0.7014	0.8211	0.7114	0.9931	0.8290	0.5541	0.8421	0.6684	0.9024	0.7817	0.8377
0.5223	18.0	6552	0.7103	0.7810	0.7983	0.7814	0.7848	0.7671	0.7778	0.7724	0.8704	0.6528	0.7460	0.8741	0.8681	0.8711	0.6042	0.7632	0.6744	0.8759	0.8451	0.8602
0.4332	19.0	6916	0.8565	0.7879	0.7985	0.7891	0.7781	0.8947	0.4722	0.6182	0.7593	0.8542	0.8039	0.8528	0.9653	0.9055	0.7032	0.7171	0.7101	0.7824	0.9366	0.8526
0.5014	20.0	7280	0.8282	0.7810	0.8140	0.7822	0.7774	0.6895	0.9097	0.7844	1.0	0.5625	0.72	0.8852	0.75	0.8120	0.7842	0.7171	0.7491	0.7113	0.9718	0.8214
0.3175	21.0	7644	2.0891	0.6019	0.7480	0.6007	0.5468	0.9048	0.1319	0.2303	0.9697	0.2222	0.3616	0.5275	1.0	0.6906	0.4595	0.7829	0.5791	0.8786	0.8662	0.8723
0.386	22.0	8008	2.6377	0.4725	0.7236	0.4744	0.4505	0.8889	0.1667	0.2807	0.8087	0.6458	0.7181	0.88	0.1528	0.2604	0.7442	0.4211	0.5378	0.2960	0.9859	0.4553
0.3569	23.0	8372	1.2083	0.7438	0.8051	0.7432	0.7255	0.9487	0.2569	0.4044	0.75	0.8542	0.7987	0.8712	0.9861	0.9251	0.5210	0.8158	0.6359	0.9344	0.8028	0.8636
0.4323	24.0	8736	0.6160	0.8347	0.8466	0.8363	0.8360	0.9153	0.75	0.8244	0.7297	0.9375	0.8207	0.8654	0.9375	0.9	0.7465	0.6974	0.7211	0.976	0.8592	0.9139
0.4918	25.0	9100	2.0400	0.6763	0.7469	0.6786	0.6300	0.9444	0.1181	0.2099	0.6755	0.8819	0.7651	0.8377	0.8958	0.8658	0.7455	0.5395	0.6260	0.5312	0.9577	0.6834
0.4046	26.0	9464	1.0405	0.7493	0.8171	0.7485	0.7405	0.7727	0.7083	0.7391	1.0	0.3333	0.5	0.8571	0.9167	0.8859	0.5198	0.8618	0.6485	0.9357	0.9225	0.9291
0.3128	27.0	9828	1.1911	0.7410	0.7797	0.7414	0.7333	0.9180	0.3889	0.5463	0.8074	0.7569	0.7814	0.8865	0.8681	0.8772	0.5556	0.7566	0.6407	0.7308	0.9366	0.8210
0.2976	28.0	10192	1.6928	0.6694	0.7389	0.6709	0.6448	0.9655	0.1944	0.3237	0.5631	0.8056	0.6629	0.7527	0.9722	0.8485	0.4780	0.5724	0.5210	0.9350	0.8099	0.8679
0.3439	29.0	10556	1.2054	0.7328	0.7920	0.7337	0.7183	0.9583	0.3194	0.4792	0.8497	0.9028	0.8754	0.88	0.7639	0.8178	0.72	0.7105	0.7152	0.552	0.9718	0.7041
0.2825	30.0	10920	0.7000	0.8209	0.8385	0.8220	0.8169	0.9659	0.5903	0.7328	0.7514	0.9236	0.8287	0.7901	0.9931	0.88	0.7671	0.7368	0.7517	0.9179	0.8662	0.8913
0.368	31.0	11284	1.3418	0.6791	0.7540	0.6799	0.6625	0.5847	0.7431	0.6544	1.0	0.2847	0.4432	0.9279	0.7153	0.8078	0.6732	0.6776	0.6754	0.5840	0.9789	0.7316
0.3205	32.0	11648	0.6867	0.8099	0.8408	0.8110	0.8065	0.6377	0.9167	0.7521	0.8590	0.9306	0.8933	0.8528	0.9653	0.9055	0.8547	0.6579	0.7435	1.0	0.5845	0.7378
0.308	33.0	12012	2.3068	0.6488	0.7220	0.6487	0.6079	0.7053	0.4653	0.5607	1.0	0.1597	0.2754	0.7391	0.9444	0.8293	0.4955	0.7303	0.5904	0.67	0.9437	0.7836
0.4305	34.0	12376	0.5981	0.8209	0.8234	0.8246	0.8158	0.8333	0.8681	0.8503	0.7326	0.9514	0.8278	0.8639	0.8819	0.8729	0.7723	0.5132	0.6166	0.9149	0.9085	0.9117
0.326	35.0	12740	2.0705	0.5937	0.7128	0.5948	0.5693	0.4230	0.8958	0.5746	0.6044	0.9444	0.7371	0.8378	0.2153	0.3425	0.8434	0.4605	0.5957	0.8553	0.4577	0.5963
0.247	36.0	13104	1.2846	0.7066	0.7747	0.7047	0.7113	0.7516	0.8194	0.7841	0.8188	0.7847	0.8014	0.8721	0.5208	0.6522	0.4904	0.8421	0.6199	0.9405	0.5563	0.6991
0.2769	37.0	13468	1.9667	0.6143	0.6984	0.6169	0.6059	0.7358	0.5417	0.624	0.4434	0.9792	0.6104	0.8413	0.3681	0.5121	0.7619	0.4211	0.5424	0.7097	0.7746	0.7407
0.2787	38.0	13832	0.6121	0.8361	0.8412	0.8377	0.8361	0.7771	0.8472	0.8106	0.9237	0.8403	0.88	0.8671	0.8611	0.8641	0.8571	0.7105	0.7770	0.7811	0.9296	0.8489
0.2929	39.0	14196	0.9656	0.7245	0.8110	0.7252	0.7242	0.9333	0.3889	0.5490	0.9516	0.8194	0.8806	0.9167	0.6875	0.7857	0.7603	0.7303	0.7450	0.4931	1.0	0.6605
0.2187	40.0	14560	1.1442	0.7190	0.7916	0.7177	0.7162	0.8142	0.6389	0.7160	1.0	0.4375	0.6087	0.6814	0.9653	0.7989	0.5359	0.8355	0.6530	0.9266	0.7113	0.8048
0.333	41.0	14924	1.3527	0.6639	0.7567	0.6622	0.6582	0.7623	0.6458	0.6992	1.0	0.375	0.5455	0.8876	0.5486	0.6781	0.4944	0.8684	0.6301	0.6392	0.8732	0.7381
0.2879	42.0	15288	0.5472	0.8581	0.8593	0.8596	0.8591	0.8944	0.8819	0.8881	0.9353	0.9028	0.9187	0.8414	0.8472	0.8443	0.7635	0.7434	0.7533	0.8618	0.9225	0.8912
0.3225	43.0	15652	3.7992	0.4229	0.6611	0.4168	0.4050	0.4272	0.3056	0.3563	0.8111	0.5069	0.6239	0.8684	0.2292	0.3626	0.2896	0.9013	0.4384	0.9091	0.1408	0.2439
0.3459	44.0	16016	3.1857	0.6350	0.7444	0.6340	0.6105	0.9643	0.1875	0.3140	0.8455	0.6458	0.7323	0.8660	0.5833	0.6971	0.5169	0.8026	0.6289	0.5294	0.9507	0.6801
0.4206	45.0	16380	1.3051	0.7218	0.7783	0.7231	0.7049	0.9783	0.3125	0.4737	0.86	0.8958	0.8776	0.7551	0.7708	0.7629	0.7372	0.6645	0.6990	0.5610	0.9718	0.7113
0.3223	46.0	16744	1.1472	0.7355	0.7930	0.7335	0.7201	0.7342	0.8056	0.7682	0.9209	0.8889	0.9046	0.7561	0.8611	0.8052	0.5541	0.8092	0.6578	1.0	0.3028	0.4649
0.3565	47.0	17108	0.9661	0.7782	0.8263	0.7774	0.7787	0.9351	0.5	0.6516	0.76	0.9236	0.8339	0.8690	0.875	0.8720	0.5766	0.8421	0.6845	0.9907	0.7465	0.8514
0.1936	48.0	17472	0.6488	0.8306	0.8447	0.8316	0.8283	0.7616	0.9097	0.8291	0.9792	0.6528	0.7833	0.7919	0.9514	0.8644	0.8394	0.7566	0.7958	0.8514	0.8873	0.8690
0.3125	49.0	17836	4.5120	0.4738	0.7968	0.4693	0.4270	1.0	0.0556	0.1053	1.0	0.0694	0.1299	0.84	0.5833	0.6885	0.2907	0.9408	0.4441	0.8534	0.6972	0.7674
0.286	50.0	18200	1.1066	0.7631	0.7712	0.7643	0.7537	0.7952	0.4583	0.5815	0.8872	0.8194	0.8520	0.7254	0.9722	0.8309	0.6980	0.6842	0.6910	0.75	0.8873	0.8129
0.3194	51.0	18564	1.5146	0.6543	0.7627	0.6513	0.6395	0.9825	0.3889	0.5572	0.7937	0.8819	0.8355	0.6270	0.8056	0.7052	0.4689	0.8421	0.6024	0.9412	0.3380	0.4974
0.2739	52.0	18928	1.0688	0.7452	0.8069	0.7468	0.7521	0.8534	0.6875	0.7615	0.9512	0.8125	0.8764	0.8866	0.5972	0.7137	0.8264	0.6579	0.7326	0.5167	0.9789	0.6764
0.2115	53.0	19292	0.9830	0.7837	0.8130	0.7836	0.7858	0.7628	0.8264	0.7933	0.9780	0.6181	0.7574	0.8780	0.75	0.8090	0.6269	0.8289	0.7139	0.8194	0.8944	0.8552
0.1773	54.0	19656	1.1812	0.7287	0.8288	0.7274	0.7351	0.9091	0.625	0.7407	1.0	0.4236	0.5951	0.8730	0.7639	0.8148	0.4642	0.8947	0.6112	0.8980	0.9296	0.9135
0.4166	55.0	20020	0.7748	0.7851	0.8210	0.7854	0.7897	0.7059	0.8333	0.7643	0.9770	0.5903	0.7359	0.85	0.8264	0.8380	0.6030	0.7895	0.6838	0.9692	0.8873	0.9265
0.2494	56.0	20384	0.8547	0.7782	0.8037	0.7787	0.7789	0.7917	0.7917	0.7917	0.9787	0.6389	0.7731	0.8512	0.7153	0.7774	0.6398	0.7829	0.7041	0.7569	0.9648	0.8483
0.2968	57.0	20748	0.7095	0.7810	0.8145	0.7859	0.7709	0.6422	0.9722	0.7735	0.9908	0.75	0.8538	0.7037	0.9236	0.7988	0.8143	0.375	0.5135	0.9214	0.9085	0.9149
0.2671	58.0	21112	1.2633	0.7466	0.8275	0.7452	0.7637	0.9263	0.6111	0.7364	0.9661	0.7917	0.8702	0.8333	0.7292	0.7778	0.4746	0.8618	0.6121	0.9369	0.7324	0.8221
0.1583	59.0	21476	0.9247	0.7879	0.8116	0.7890	0.7865	0.7891	0.7014	0.7426	0.9892	0.6389	0.7764	0.8497	0.9028	0.8754	0.7603	0.7303	0.7450	0.6699	0.9718	0.7931
0.5213	60.0	21840	2.4814	0.6088	0.7614	0.6051	0.6010	0.5336	0.8264	0.6485	0.9647	0.5694	0.7162	0.8675	0.5	0.6344	0.4411	0.8618	0.5835	1.0	0.2676	0.4222
0.3362	61.0	22204	0.9654	0.7810	0.8263	0.7810	0.7841	0.9438	0.5833	0.7210	0.9903	0.7083	0.8259	0.6717	0.9236	0.7778	0.6193	0.8026	0.6991	0.9065	0.8873	0.8968
0.3507	62.0	22568	2.6933	0.6074	0.8067	0.6041	0.6323	0.9677	0.4167	0.5825	0.9577	0.4722	0.6326	0.8496	0.6667	0.7471	0.3495	0.9013	0.5037	0.9091	0.5634	0.6957
0.2981	63.0	22932	0.5280	0.8581	0.8602	0.8599	0.8583	0.7963	0.8958	0.8431	0.9385	0.8472	0.8905	0.8671	0.8611	0.8641	0.8029	0.7237	0.7612	0.8961	0.9718	0.9324
0.1905	64.0	23296	1.9495	0.6212	0.7104	0.6198	0.6317	0.8986	0.4306	0.5822	0.7397	0.75	0.7448	0.75	0.5208	0.6148	0.3925	0.7566	0.5169	0.7712	0.6408	0.7
0.3515	65.0	23660	1.3202	0.7066	0.7771	0.7053	0.7020	0.8971	0.4236	0.5755	0.5947	0.9375	0.7278	0.8321	0.7917	0.8114	0.5735	0.7961	0.6667	0.9880	0.5775	0.7289
0.2444	66.0	24024	9.7033	0.3595	0.5270	0.3560	0.2437	0.0	0.0	0.0	1.0	0.0069	0.0138	0.9524	0.1389	0.2424	0.3538	0.7961	0.4899	0.3287	0.8380	0.4722
0.284	67.0	24388	0.5948	0.7810	0.8167	0.7803	0.7881	0.8158	0.8611	0.8378	0.9727	0.7431	0.8425	0.7540	0.6597	0.7037	0.5837	0.8487	0.6917	0.9573	0.7887	0.8649
0.2848	68.0	24752	1.3576	0.7727	0.8217	0.7738	0.7511	1.0	0.2847	0.4432	0.6635	0.9722	0.7887	0.8718	0.9444	0.9067	0.6158	0.7171	0.6626	0.9574	0.9507	0.9541
0.2382	69.0	25116	0.5605	0.8485	0.8468	0.8510	0.8469	0.8630	0.875	0.8690	0.8344	0.9444	0.8860	0.8503	0.8681	0.8591	0.776	0.6382	0.7004	0.9103	0.9296	0.9199
0.3392	70.0	25480	3.4095	0.6074	0.7559	0.6055	0.5693	0.8056	0.2014	0.3222	1.0	0.1875	0.3158	0.7836	0.9306	0.8508	0.3772	0.8487	0.5223	0.8133	0.8592	0.8356
0.2065	71.0	25844	0.6199	0.8264	0.8513	0.8261	0.8323	0.8247	0.8819	0.8523	0.9767	0.875	0.9231	0.8333	0.7639	0.7971	0.64	0.8421	0.7273	0.9820	0.7676	0.8617
0.2027	72.0	26208	2.3450	0.6116	0.7172	0.6119	0.5953	0.8125	0.4514	0.5804	0.7862	0.7917	0.7889	0.9730	0.25	0.3978	0.5650	0.6579	0.6079	0.4495	0.9085	0.6014
0.2532	73.0	26572	1.3719	0.7452	0.8450	0.7441	0.7545	0.9651	0.5764	0.7217	0.9857	0.4792	0.6449	0.8844	0.9028	0.8935	0.4634	0.875	0.6059	0.9265	0.8873	0.9065
0.1423	74.0	26936	1.2969	0.7342	0.8113	0.7327	0.7463	0.8810	0.5139	0.6491	0.9	0.8125	0.8540	0.8519	0.7986	0.8244	0.4727	0.8553	0.6089	0.9510	0.6831	0.7951
0.1761	75.0	27300	0.5368	0.8623	0.8682	0.8634	0.8632	0.9492	0.7778	0.8550	0.9	0.9375	0.9184	0.8	0.9167	0.8544	0.7697	0.7697	0.7697	0.9220	0.9155	0.9187
0.3582	76.0	27664	1.1069	0.7796	0.8323	0.7791	0.7814	0.8812	0.6181	0.7265	1.0	0.5625	0.72	0.8649	0.8889	0.8767	0.5546	0.8684	0.6769	0.8608	0.9577	0.9067
0.1635	77.0	28028	0.9810	0.7934	0.8106	0.7980	0.7840	0.7647	0.8125	0.7879	0.6605	0.9861	0.7911	0.8516	0.9167	0.8829	0.7922	0.4013	0.5328	0.9841	0.8732	0.9254
0.2325	78.0	28392	1.0597	0.7879	0.8341	0.7873	0.7961	0.9394	0.6458	0.7654	0.9652	0.7708	0.8571	0.8605	0.7708	0.8132	0.5598	0.8618	0.6788	0.8456	0.8873	0.8660
0.2405	79.0	28756	2.0543	0.6653	0.7992	0.6629	0.6757	0.9273	0.3542	0.5126	0.8521	0.8403	0.8462	0.8443	0.7153	0.7744	0.3976	0.8553	0.5428	0.975	0.5493	0.7027
0.4338	80.0	29120	1.6266	0.7121	0.7562	0.7119	0.6903	0.7536	0.3611	0.4883	1.0	0.4653	0.6351	0.7448	0.9931	0.8512	0.5941	0.7895	0.6780	0.6888	0.9507	0.7988
0.189	81.0	29484	0.9406	0.7879	0.8029	0.7923	0.7809	0.6347	0.9653	0.7658	0.8667	0.8125	0.8387	0.8571	0.8333	0.8451	0.7647	0.4276	0.5485	0.8912	0.9225	0.9066
0.275	82.0	29848	0.8044	0.7810	0.8149	0.7814	0.7838	0.9255	0.6042	0.7311	0.6650	0.9514	0.7829	0.8473	0.7708	0.8073	0.6534	0.7566	0.7012	0.9832	0.8239	0.8966
0.2297	83.0	30212	5.9964	0.5289	0.6712	0.5279	0.4845	0.9333	0.0972	0.1761	0.8364	0.3194	0.4623	0.5954	0.5417	0.5673	0.5904	0.7303	0.6529	0.4006	0.9507	0.5637
0.1263	84.0	30576	1.2614	0.7493	0.7718	0.7511	0.7400	0.8784	0.4514	0.5963	0.7778	0.9236	0.8444	0.8571	0.7917	0.8231	0.7029	0.6382	0.6690	0.6429	0.9507	0.7670
0.2283	85.0	30940	0.7674	0.8030	0.8427	0.8027	0.8098	0.9706	0.6875	0.8049	0.9104	0.8472	0.8777	0.7471	0.9028	0.8176	0.6039	0.8224	0.6964	0.9817	0.7535	0.8526
0.1926	86.0	31304	1.0907	0.7837	0.8336	0.7875	0.7812	0.5703	0.9861	0.7226	0.9891	0.6319	0.7712	0.8618	0.9097	0.8851	0.8488	0.4803	0.6134	0.8980	0.9296	0.9135
0.2539	87.0	31668	1.1948	0.7782	0.8173	0.7782	0.7832	0.9091	0.5556	0.6897	0.9147	0.8194	0.8645	0.8582	0.7986	0.8273	0.5511	0.8158	0.6578	0.8533	0.9014	0.8767
0.2203	88.0	32032	0.9832	0.7645	0.7998	0.7644	0.7664	0.6667	0.9306	0.7768	0.9355	0.8056	0.8657	0.7655	0.7708	0.7682	0.6433	0.7237	0.6811	0.9882	0.5915	0.7401
0.2361	89.0	32396	4.8401	0.4711	0.7411	0.4656	0.4000	1.0	0.1181	0.2112	0.9455	0.3611	0.5226	0.5625	0.9375	0.7031	0.3227	0.8618	0.4695	0.875	0.0493	0.0933
0.2091	90.0	32760	1.1061	0.7479	0.8401	0.7469	0.7662	0.9877	0.5556	0.7111	0.9091	0.7639	0.8302	0.8605	0.7708	0.8132	0.4607	0.8487	0.5972	0.9826	0.7958	0.8794
0.2262	91.0	33124	0.9346	0.7769	0.8112	0.7790	0.7742	0.9451	0.5972	0.7319	0.8144	0.9444	0.8746	0.8537	0.7292	0.7865	0.8291	0.6382	0.7212	0.6140	0.9859	0.7568
0.1587	92.0	33488	0.5911	0.8747	0.8747	0.8769	0.8738	0.9214	0.8958	0.9085	0.8476	0.9653	0.9026	0.8553	0.9028	0.8784	0.8125	0.6842	0.7429	0.9366	0.9366	0.9366
0.1668	93.0	33852	1.6945	0.6584	0.7523	0.6569	0.6586	0.4872	0.9236	0.6379	0.8230	0.6458	0.7237	0.8710	0.5625	0.6835	0.5968	0.7303	0.6568	0.9836	0.4225	0.5911
0.1473	94.0	34216	1.6512	0.6832	0.8307	0.6804	0.6985	0.9620	0.5278	0.6816	0.9792	0.6528	0.7833	0.8038	0.8819	0.8411	0.4085	0.8816	0.5583	1.0	0.4577	0.6280
0.2726	95.0	34580	1.9192	0.6143	0.8272	0.6106	0.6425	0.9545	0.4375	0.6	0.9789	0.6458	0.7782	0.8558	0.6181	0.7177	0.3467	0.9079	0.5018	1.0	0.4437	0.6146
0.2871	96.0	34944	1.9940	0.6570	0.7514	0.6566	0.6525	0.4792	0.9583	0.6389	0.95	0.3958	0.5588	0.9103	0.4931	0.6396	0.6545	0.7105	0.6814	0.7630	0.7254	0.7437
0.2305	97.0	35308	1.3152	0.7080	0.8119	0.7063	0.7285	0.9457	0.6042	0.7373	0.8992	0.8056	0.8498	0.7949	0.6458	0.7126	0.4310	0.8421	0.5702	0.9890	0.6338	0.7725
0.2465	98.0	35672	1.1943	0.7672	0.8213	0.7656	0.7637	0.9333	0.6806	0.7871	0.8654	0.9375	0.9	0.7288	0.8958	0.8037	0.5792	0.8421	0.6863	1.0	0.4718	0.6411
0.1739	99.0	36036	0.8183	0.8264	0.8244	0.8286	0.8254	0.8369	0.8194	0.8281	0.8693	0.9236	0.8956	0.84	0.875	0.8571	0.7424	0.6447	0.6901	0.8333	0.8803	0.8562
0.1917	100.0	36400	2.1049	0.6901	0.7855	0.6890	0.6700	1.0	0.3403	0.5078	0.9844	0.4375	0.6058	0.6484	0.9861	0.7824	0.5385	0.8289	0.6528	0.7562	0.8521	0.8013
0.1258	101.0	36764	0.9476	0.8264	0.8401	0.8275	0.8227	0.8788	0.6042	0.7160	0.9669	0.8125	0.8830	0.8313	0.9583	0.8903	0.7852	0.7697	0.7774	0.7382	0.9930	0.8468
0.3102	102.0	37128	2.2261	0.6474	0.7617	0.6454	0.6117	1.0	0.3611	0.5306	0.6832	0.9583	0.7977	0.6296	0.9444	0.7556	0.4955	0.7237	0.5882	1.0	0.2394	0.3864
0.2339	103.0	37492	4.9547	0.4394	0.7228	0.4347	0.4335	0.8824	0.2083	0.3371	0.9	0.25	0.3913	0.8605	0.2569	0.3957	0.2753	0.8947	0.4211	0.6957	0.5634	0.6226
0.1609	104.0	37856	1.2982	0.7700	0.8024	0.7717	0.7664	0.975	0.5417	0.6964	0.8199	0.9167	0.8656	0.8538	0.7708	0.8102	0.7319	0.6645	0.6966	0.6313	0.9648	0.7632
0.2037	105.0	38220	1.7334	0.6736	0.8253	0.6716	0.6974	0.9853	0.4653	0.6321	0.9176	0.5417	0.6812	0.8534	0.6875	0.7615	0.3878	0.875	0.5374	0.9825	0.7887	0.875
0.1627	106.0	38584	1.2770	0.7906	0.8201	0.7921	0.7798	1.0	0.4583	0.6286	0.8471	0.9236	0.8837	0.7888	0.8819	0.8328	0.7714	0.7105	0.7397	0.6931	0.9859	0.8140
0.1985	107.0	38948	0.7336	0.8223	0.8381	0.8222	0.8258	0.8551	0.8194	0.8369	0.9044	0.8542	0.8786	0.8038	0.8819	0.8411	0.6721	0.8092	0.7343	0.9550	0.7465	0.8379
0.2462	108.0	39312	0.6392	0.8554	0.8583	0.8581	0.8530	0.8198	0.9792	0.8924	0.9603	0.8403	0.8963	0.8723	0.8542	0.8632	0.8017	0.6382	0.7106	0.8373	0.9789	0.9026
0.165	109.0	39676	4.0560	0.6377	0.7508	0.6394	0.6200	0.7683	0.4375	0.5575	1.0	0.2639	0.4176	0.8481	0.9306	0.8874	0.704	0.5789	0.6354	0.4334	0.9859	0.6022
0.2116	110.0	40040	3.4035	0.5909	0.7279	0.5878	0.5355	1.0	0.1597	0.2754	0.6885	0.875	0.7706	0.6	0.9167	0.7253	0.4419	0.7763	0.5632	0.9091	0.2113	0.3429
0.1988	111.0	40404	0.9592	0.8030	0.8312	0.8031	0.8077	0.8462	0.8403	0.8432	0.8675	0.9097	0.8881	0.8472	0.8472	0.8472	0.5949	0.7632	0.6686	1.0	0.6549	0.7915
0.1728	112.0	40768	1.4039	0.7562	0.8180	0.7552	0.7537	0.9252	0.6875	0.7888	0.8912	0.9097	0.9003	0.5643	0.9444	0.7065	0.7091	0.7697	0.7382	1.0	0.4648	0.6346
0.2872	113.0	41132	1.0270	0.7603	0.8068	0.7599	0.7613	0.6453	0.9097	0.7550	0.9810	0.7153	0.8273	0.7764	0.8681	0.8197	0.6441	0.75	0.6930	0.9875	0.5563	0.7117
0.1523	114.0	41496	1.8516	0.6873	0.7650	0.6853	0.6985	0.6759	0.6806	0.6782	0.9231	0.75	0.8276	0.8539	0.5278	0.6524	0.4659	0.8553	0.6032	0.9062	0.6127	0.7311
0.1601	115.0	41860	1.4252	0.7686	0.8087	0.7690	0.7453	1.0	0.2986	0.4599	0.9034	0.9097	0.9066	0.7081	0.9097	0.7964	0.6941	0.7763	0.7329	0.7377	0.9507	0.8308
0.1934	116.0	42224	1.0761	0.8003	0.8124	0.8065	0.7753	0.6792	1.0	0.8090	0.8571	0.9167	0.8859	0.8366	0.8889	0.8620	0.8235	0.2763	0.4138	0.8654	0.9507	0.9060
0.1296	117.0	42588	0.9574	0.8182	0.8567	0.8181	0.8211	0.9759	0.5625	0.7137	0.9538	0.8611	0.9051	0.8280	0.9028	0.8638	0.5972	0.8487	0.7011	0.9286	0.9155	0.9220
0.1667	118.0	42952	1.5463	0.7052	0.7376	0.7064	0.7098	0.7218	0.6667	0.6931	0.655	0.9097	0.7616	0.8469	0.5764	0.6860	0.5167	0.6118	0.5602	0.9478	0.7676	0.8482
0.1485	119.0	43316	4.6610	0.5207	0.6658	0.5226	0.4893	0.8788	0.2014	0.3277	0.8571	0.2917	0.4352	0.4098	0.9306	0.5690	0.6966	0.4079	0.5145	0.4868	0.7817	0.6
0.1318	120.0	43680	1.0993	0.7893	0.8193	0.7892	0.7906	0.9444	0.5903	0.7265	0.8929	0.8681	0.8803	0.8455	0.7222	0.7790	0.6029	0.8289	0.6981	0.8110	0.9366	0.8693
0.2371	121.0	44044	8.0913	0.4972	0.6707	0.4972	0.4656	0.8333	0.1042	0.1852	0.7805	0.4444	0.5664	0.8070	0.3194	0.4577	0.5864	0.625	0.6051	0.3464	0.9930	0.5137
0.1721	122.0	44408	1.0303	0.8168	0.8227	0.8183	0.8150	0.8909	0.6806	0.7717	0.9	0.9375	0.9184	0.7711	0.8889	0.8258	0.7970	0.6974	0.7439	0.7545	0.8873	0.8155
0.3003	123.0	44772	4.5488	0.4339	0.7836	0.4344	0.4222	0.85	0.2361	0.3696	1.0	0.2569	0.4088	1.0	0.1597	0.2754	0.8	0.5263	0.6349	0.2681	0.9930	0.4222
0.1306	124.0	45136	1.0231	0.7879	0.8620	0.7868	0.8018	0.9789	0.6458	0.7782	1.0	0.7986	0.8880	0.8113	0.8958	0.8515	0.5197	0.8684	0.6502	1.0	0.7254	0.8408
0.1423	125.0	45500	0.9325	0.8168	0.8355	0.8174	0.8180	0.7950	0.8889	0.8393	1.0	0.7847	0.8794	0.9083	0.6875	0.7826	0.7186	0.7895	0.7524	0.7557	0.9366	0.8365
0.1867	126.0	45864	3.4378	0.6804	0.7780	0.6803	0.6426	0.6957	0.7778	0.7344	1.0	0.0833	0.1538	0.8408	0.9167	0.8771	0.4346	0.7434	0.5485	0.9191	0.8803	0.8993
0.1402	127.0	46228	2.3312	0.7025	0.8111	0.7014	0.6846	1.0	0.2014	0.3353	0.9596	0.6597	0.7819	0.7895	0.9375	0.8571	0.4523	0.8421	0.5885	0.8542	0.8662	0.8601
0.2222	128.0	46592	2.4998	0.7300	0.7824	0.7298	0.6892	1.0	0.1597	0.2754	0.7389	0.9236	0.8210	0.7616	0.9097	0.8291	0.6010	0.7829	0.68	0.8105	0.8732	0.8407
0.1835	129.0	46956	5.8303	0.4435	0.4147	0.4381	0.3798	0.4444	0.6111	0.5146	0.7736	0.5694	0.656	0.0	0.0	0.0	0.3439	0.8553	0.4906	0.5116	0.1549	0.2378
0.2269	130.0	47320	2.9031	0.6240	0.7550	0.6222	0.6167	0.9512	0.2708	0.4216	0.9062	0.6042	0.725	0.8571	0.5	0.6316	0.4175	0.8487	0.5597	0.6429	0.8873	0.7456
0.136	131.0	47684	1.6164	0.6653	0.7618	0.6647	0.6609	0.8721	0.5208	0.6522	0.9364	0.7153	0.8110	0.9298	0.3681	0.5274	0.5613	0.7829	0.6538	0.5096	0.9366	0.6600
0.1439	132.0	48048	2.2665	0.6983	0.7866	0.6974	0.6912	0.9756	0.2778	0.4324	0.8105	0.8611	0.8350	0.8559	0.7014	0.7710	0.4542	0.8158	0.5835	0.8369	0.8310	0.8339
0.1593	133.0	48412	0.8721	0.8347	0.8601	0.8347	0.8420	0.8971	0.8472	0.8714	0.9143	0.8889	0.9014	0.875	0.7778	0.8235	0.6225	0.8355	0.7135	0.9915	0.8239	0.9
0.202	134.0	48776	0.7894	0.8182	0.8372	0.8188	0.8206	0.9394	0.6458	0.7654	0.8649	0.8889	0.8767	0.8696	0.8333	0.8511	0.6316	0.7895	0.7018	0.8808	0.9366	0.9078
0.7143	135.0	49140	2.3021	0.6708	0.7874	0.6693	0.6432	0.5278	0.9236	0.6717	1.0	0.1597	0.2754	0.8662	0.8542	0.8601	0.5430	0.7895	0.6434	1.0	0.6197	0.7652
0.1899	136.0	49504	1.6460	0.6515	0.8051	0.6490	0.6772	0.8767	0.4444	0.5899	0.96	0.6667	0.7869	0.8218	0.5764	0.6776	0.3775	0.8816	0.5286	0.9897	0.6761	0.8033
0.1565	137.0	49868	1.7804	0.7149	0.7747	0.7147	0.7063	0.7652	0.7014	0.7319	1.0	0.3611	0.5306	0.8561	0.7847	0.8188	0.5333	0.7895	0.6366	0.7189	0.9366	0.8135
0.1363	138.0	50232	3.4435	0.5041	0.6933	0.5017	0.4899	0.7843	0.2778	0.4103	0.3621	0.875	0.5122	0.8571	0.4583	0.5973	0.4630	0.6579	0.5435	1.0	0.2394	0.3864
0.0519	139.0	50596	0.8779	0.7975	0.8098	0.7984	0.7992	0.6703	0.8611	0.7538	0.8898	0.7292	0.8015	0.8819	0.7778	0.8266	0.7724	0.7368	0.7542	0.8344	0.8873	0.8601
0.4079	140.0	50960	1.7080	0.6612	0.7434	0.6618	0.6599	0.8018	0.6181	0.6980	0.9462	0.6111	0.7426	0.8676	0.4097	0.5566	0.6047	0.6842	0.6420	0.4965	0.9859	0.6604
0.1648	141.0	51324	2.5691	0.6598	0.7517	0.6587	0.6078	0.8235	0.4861	0.6114	1.0	0.0972	0.1772	0.7458	0.9167	0.8224	0.504	0.8289	0.6269	0.685	0.9648	0.8012
0.134	142.0	51688	1.5630	0.7700	0.8081	0.7738	0.7631	0.8976	0.7917	0.8413	0.7316	0.9653	0.8323	0.8727	0.6667	0.7559	0.9114	0.4737	0.6234	0.6273	0.9718	0.7624
0.1752	143.0	52052	1.2265	0.7755	0.8027	0.7761	0.7720	0.7419	0.7986	0.7692	0.9875	0.5486	0.7054	0.8582	0.7986	0.8273	0.7267	0.7697	0.7476	0.6990	0.9648	0.8107
0.1366	144.0	52416	2.4039	0.6129	0.7119	0.6101	0.5804	0.5780	0.6944	0.6309	0.6461	0.7986	0.7143	0.8684	0.6875	0.7674	0.4672	0.75	0.5758	1.0	0.1197	0.2138
0.4067	145.0	52780	1.7158	0.7176	0.8031	0.7165	0.7189	0.7714	0.75	0.7606	1.0	0.3681	0.5381	0.82	0.8542	0.8367	0.4757	0.8355	0.6062	0.9483	0.7746	0.8527
0.1673	146.0	53144	1.4298	0.7727	0.7929	0.7743	0.7668	0.8902	0.5069	0.6460	0.8639	0.8819	0.8729	0.8207	0.8264	0.8235	0.7324	0.6842	0.7075	0.6571	0.9718	0.7841
0.1853	147.0	53508	0.9835	0.7906	0.8068	0.7916	0.7900	0.9238	0.6736	0.7791	0.7619	0.8889	0.8205	0.875	0.6806	0.7656	0.6628	0.75	0.7037	0.8107	0.9648	0.8810
0.1954	148.0	53872	0.9705	0.7837	0.8044	0.7848	0.7806	0.7182	0.9028	0.8	0.8187	0.9722	0.8889	0.8182	0.8125	0.8153	0.6667	0.6447	0.6555	1.0	0.5915	0.7434
0.118	149.0	54236	0.6951	0.8402	0.8627	0.8403	0.8455	0.9274	0.7986	0.8582	0.9688	0.8611	0.9118	0.7674	0.9167	0.8354	0.6757	0.8224	0.7418	0.9744	0.8028	0.8803
0.1205	150.0	54600	0.8478	0.8609	0.8648	0.8628	0.8606	0.8	0.9444	0.8662	0.8832	0.8403	0.8612	0.85	0.9444	0.8947	0.8217	0.6974	0.7544	0.9692	0.8873	0.9265

Framework versions

• Transformers 4.48.3
• Pytorch 2.5.1+cu124
• Datasets 3.3.2
• Tokenizers 0.21.0