Layoutlmv3-finetuned-DocLayNet-large_v1

This model is a fine-tuned version of microsoft/layoutlmv3-base on the doc_lay_net-small dataset. It achieves the following results on the evaluation set:

• Loss: 0.8274
• Precision: 0.7450
• Recall: 0.8228
• F1: 0.7820
• Accuracy: 0.9008

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 1e-05
• train_batch_size: 4
• eval_batch_size: 4
• seed: 42
• distributed_type: multi-GPU
• num_devices: 4
• total_train_batch_size: 16
• total_eval_batch_size: 16
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_ratio: 0.1
• training_steps: 100000
• mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Precision	Recall	F1	Accuracy
2.2808	2.9070	250	2.1399	0.0105	0.0174	0.0131	0.4880
1.7304	5.8140	500	1.3878	0.1034	0.0435	0.0613	0.6214
1.199	8.7209	750	1.0123	0.1597	0.1001	0.1231	0.7660
0.908	11.6279	1000	0.8142	0.1811	0.1277	0.1498	0.7888
0.7179	14.5349	1250	0.7481	0.3301	0.2990	0.3138	0.8287
0.5836	17.4419	1500	0.7861	0.4522	0.5007	0.4752	0.8101
0.4642	20.3488	1750	0.9192	0.4780	0.5835	0.5255	0.7816
0.3663	23.2558	2000	0.9241	0.5351	0.6531	0.5882	0.8363
0.2605	26.1628	2250	0.9886	0.5995	0.6865	0.6401	0.8530
0.1862	29.0698	2500	1.1498	0.6170	0.7039	0.6576	0.8393
0.1224	31.9767	2750	1.2828	0.6223	0.6647	0.6428	0.8280
0.0845	34.8837	3000	1.2613	0.6866	0.6996	0.6930	0.8834
0.0596	37.7907	3250	1.3893	0.6991	0.6981	0.6986	0.8793
0.0452	40.6977	3500	0.7531	0.7041	0.7184	0.7112	0.8929
0.0279	43.6047	3750	1.2191	0.7145	0.7083	0.7114	0.8837
0.0194	46.5116	4000	1.4407	0.7330	0.7054	0.7189	0.8905
0.0174	49.4186	4250	1.9032	0.7274	0.7126	0.7199	0.8455
0.0211	52.3256	4500	1.6127	0.7744	0.7721	0.7733	0.8883
0.0143	55.2326	4750	1.7433	0.7208	0.7155	0.7181	0.8808
0.0121	58.1395	5000	1.7608	0.7677	0.7388	0.7530	0.8777
0.0119	61.0465	5250	1.7930	0.7468	0.7707	0.7586	0.8947
0.0118	63.9535	5500	0.5778	0.7994	0.7634	0.7810	0.9154
0.0126	66.8605	5750	0.6151	0.7748	0.8041	0.7892	0.9270
0.0195	69.7674	6000	0.6372	0.7972	0.8157	0.8063	0.9133
0.01	72.6744	6250	1.3317	0.7727	0.7300	0.7507	0.9020
0.0099	75.5814	6500	1.9056	0.7899	0.7257	0.7564	0.8989
0.0097	78.4884	6750	0.5787	0.7658	0.7213	0.7429	0.9223
0.0224	81.3953	7000	0.5940	0.8024	0.7837	0.7930	0.9179
0.0356	84.3023	7250	0.7939	0.7571	0.7373	0.7471	0.9018
0.01	87.2093	7500	0.9819	0.7409	0.7054	0.7227	0.8911
0.005	90.1163	7750	1.1069	0.7760	0.7896	0.7827	0.9057
0.0175	93.0233	8000	1.9949	0.7865	0.7431	0.7642	0.9099
0.0126	95.9302	8250	2.1588	0.7577	0.7896	0.7733	0.8609
0.0108	98.8372	8500	0.6902	0.7810	0.7402	0.7601	0.9151
0.0171	101.7442	8750	0.6826	0.7991	0.7562	0.7770	0.9259
0.0092	104.6512	9000	2.0194	0.7664	0.7808	0.7735	0.8757
0.0072	107.5581	9250	2.1912	0.7635	0.7823	0.7728	0.8606
0.0126	110.4651	9500	1.3529	0.7967	0.7620	0.7789	0.8923
0.0056	113.3721	9750	2.4010	0.7369	0.7765	0.7562	0.8618
0.0166	116.2791	10000	0.6759	0.7718	0.8345	0.8020	0.9161
0.0186	119.1860	10250	0.6970	0.7813	0.8142	0.7974	0.9209
0.0035	122.0930	10500	0.6860	0.7924	0.8142	0.8031	0.9286
0.0118	125.0	10750	0.8230	0.7639	0.7184	0.7405	0.9160
0.0205	127.9070	11000	0.5548	0.8114	0.7620	0.7859	0.9367
0.0018	130.8140	11250	0.5767	0.8163	0.7866	0.8012	0.9351
0.0133	133.7209	11500	0.5914	0.7872	0.7678	0.7774	0.9374
0.0056	136.6279	11750	0.6201	0.7829	0.7954	0.7891	0.9344
0.0044	139.5349	12000	2.1754	0.7415	0.7620	0.7516	0.8721
0.0058	142.4419	12250	0.6172	0.7982	0.7866	0.7924	0.9351
0.0025	145.3488	12500	0.8157	0.7659	0.6981	0.7304	0.9048
0.0052	148.2558	12750	0.6695	0.8	0.7954	0.7977	0.9324
0.0193	151.1628	13000	0.5561	0.8091	0.7750	0.7917	0.9361
0.0047	154.0698	13250	2.1906	0.7688	0.7141	0.7404	0.8873
0.0035	156.9767	13500	0.6063	0.8264	0.8084	0.8173	0.9373
0.0026	159.8837	13750	1.1918	0.7657	0.7968	0.7809	0.9143
0.0101	162.7907	14000	2.3092	0.7634	0.7446	0.7539	0.8888
0.0061	165.6977	14250	1.8615	0.7977	0.8186	0.8080	0.9138
0.001	168.6047	14500	1.8482	0.8051	0.7794	0.7920	0.9136
0.0028	171.5116	14750	2.9775	0.7762	0.6996	0.7359	0.8665
0.0078	174.4186	15000	1.1426	0.7706	0.7605	0.7655	0.9136
0.0054	177.3256	15250	2.0031	0.6997	0.7576	0.7275	0.8643
0.0049	180.2326	15500	1.9320	0.7858	0.7562	0.7707	0.8969
0.0009	183.1395	15750	2.4531	0.7699	0.7576	0.7637	0.8852
0.0031	186.0465	16000	2.1595	0.7762	0.7097	0.7415	0.8967
0.0044	188.9535	16250	1.9143	0.7790	0.8084	0.7934	0.9119
0.0065	191.8605	16500	1.0199	0.8039	0.7736	0.7885	0.9124
0.0027	194.7674	16750	1.4726	0.7948	0.7591	0.7765	0.9057
0.0071	197.6744	17000	0.6398	0.8212	0.8331	0.8271	0.9268
0.001	200.5814	17250	0.8224	0.8145	0.8157	0.8151	0.9254
0.0005	203.4884	17500	1.0410	0.8136	0.7794	0.7961	0.9168
0.0028	206.3953	17750	2.4992	0.7855	0.7547	0.7698	0.8971
0.0105	209.3023	18000	1.2247	0.7971	0.7184	0.7557	0.8954
0.0027	212.2093	18250	1.4073	0.7904	0.7388	0.7637	0.9054
0.0044	215.1163	18500	1.2638	0.7912	0.7315	0.7602	0.9137
0.0011	218.0233	18750	0.6571	0.8134	0.7779	0.7953	0.9370
0.0018	220.9302	19000	0.7922	0.8052	0.7199	0.7602	0.9188
0.0006	223.8372	19250	0.8057	0.8017	0.7039	0.7496	0.9246
0.0051	226.7442	19500	2.4179	0.7456	0.6763	0.7093	0.8813
0.0006	229.6512	19750	0.6147	0.8062	0.7968	0.8015	0.9375
0.0006	232.5581	20000	0.9997	0.8136	0.7663	0.7892	0.9111
0.0023	235.4651	20250	0.6525	0.8047	0.6996	0.7484	0.9203
0.0005	238.3721	20500	0.9709	0.7681	0.6633	0.7118	0.9058
0.0019	241.2791	20750	0.6255	0.8058	0.8070	0.8064	0.9258
0.0032	244.1860	21000	1.8875	0.8096	0.7097	0.7564	0.8977
0.0174	247.0930	21250	1.7731	0.7825	0.8041	0.7931	0.9105
0.0036	250.0	21500	0.7829	0.7932	0.8070	0.8000	0.9230
0.0003	252.9070	21750	0.7106	0.8003	0.8026	0.8014	0.9244
0.0081	255.8140	22000	0.9464	0.8095	0.7954	0.8023	0.9025
0.0055	258.7209	22250	0.7462	0.7948	0.7983	0.7965	0.9286
0.0021	261.6279	22500	1.0318	0.7813	0.7881	0.7847	0.9052
0.0007	264.5349	22750	0.7157	0.8477	0.7837	0.8145	0.9322
0.002	267.4419	23000	0.6027	0.8284	0.8128	0.8205	0.9344
0.0003	270.3488	23250	0.5735	0.8263	0.8215	0.8239	0.9465
0.0022	273.2558	23500	0.8612	0.8279	0.8171	0.8225	0.9313
0.0014	276.1628	23750	0.7253	0.7991	0.8142	0.8066	0.9304
0.0016	279.0698	24000	0.8026	0.7847	0.7721	0.7783	0.9157
0.0013	281.9767	24250	0.6583	0.7853	0.7750	0.7801	0.9361
0.0019	284.8837	24500	0.9548	0.7559	0.7460	0.7509	0.9013
0.0011	287.7907	24750	0.7914	0.7679	0.7634	0.7656	0.9266
0.0	290.6977	25000	0.8382	0.7736	0.7736	0.7736	0.9231
0.0003	293.6047	25250	0.8112	0.7907	0.7620	0.7761	0.9125
0.0014	296.5116	25500	0.8203	0.7719	0.7663	0.7691	0.9184
0.0018	299.4186	25750	0.7593	0.7867	0.8244	0.8051	0.9311
0.0003	302.3256	26000	2.5701	0.7796	0.7649	0.7722	0.8969
0.0005	305.2326	26250	0.8638	0.7923	0.7750	0.7836	0.9121
0.0	308.1395	26500	0.9741	0.7801	0.7518	0.7657	0.9089
0.0009	311.0465	26750	0.7986	0.7941	0.8171	0.8054	0.9232
0.0004	313.9535	27000	0.6911	0.8056	0.8302	0.8177	0.9326
0.0002	316.8605	27250	0.7305	0.8134	0.8099	0.8116	0.9306
0.0	319.7674	27500	0.7376	0.8163	0.8128	0.8145	0.9300
0.0	322.6744	27750	0.7497	0.8090	0.8113	0.8101	0.9286
0.0004	325.5814	28000	0.9007	0.7879	0.7547	0.7709	0.9183
0.0106	328.4884	28250	0.7447	0.7816	0.8157	0.7983	0.9150
0.0119	331.3953	28500	1.9281	0.7824	0.7983	0.7902	0.9152
0.0001	334.3023	28750	2.1278	0.7629	0.7286	0.7454	0.9022
0.0006	337.2093	29000	2.3032	0.7568	0.6821	0.7176	0.9002
0.0053	340.1163	29250	1.4272	0.7524	0.6967	0.7234	0.8821
0.0025	343.0233	29500	1.8358	0.7785	0.7141	0.7449	0.9003
0.0003	345.9302	29750	2.5302	0.7528	0.6851	0.7173	0.9094
0.0001	348.8372	30000	2.9034	0.7774	0.7199	0.7476	0.8873
0.0004	351.7442	30250	1.9982	0.7413	0.7112	0.7259	0.8740
0.0053	354.6512	30500	0.9427	0.8067	0.7388	0.7712	0.9058
0.0001	357.5581	30750	1.0369	0.7833	0.7344	0.7581	0.8999
0.0002	360.4651	31000	1.0245	0.7713	0.7489	0.7599	0.8905
0.0044	363.3721	31250	2.2735	0.7766	0.7518	0.7640	0.9047
0.0006	366.2791	31500	2.4838	0.7485	0.7170	0.7324	0.8981
0.0026	369.1860	31750	2.4995	0.7807	0.7649	0.7727	0.8932
0.0016	372.0930	32000	2.6001	0.7339	0.8084	0.7693	0.9020
0.0003	375.0	32250	2.8600	0.7766	0.7518	0.7640	0.9051
0.0	377.9070	32500	2.8784	0.7671	0.7315	0.7489	0.8982
0.0004	380.8140	32750	2.9974	0.7758	0.7533	0.7644	0.9063
0.0001	383.7209	33000	1.8990	0.7887	0.7910	0.7899	0.9005
0.0016	386.6279	33250	1.9909	0.7695	0.7750	0.7722	0.8826
0.0001	389.5349	33500	2.4333	0.7888	0.7591	0.7737	0.9075
0.0009	392.4419	33750	2.0187	0.7329	0.7010	0.7166	0.8623
0.0012	395.3488	34000	0.7712	0.8206	0.7170	0.7653	0.9324
0.0017	398.2558	34250	1.9201	0.7613	0.7823	0.7717	0.8922
0.0	401.1628	34500	2.6731	0.7415	0.7286	0.7350	0.9004
0.0006	404.0698	34750	3.1499	0.7718	0.6821	0.7242	0.8949
0.0173	406.9767	35000	2.4925	0.7763	0.7402	0.7578	0.8929
0.0001	409.8837	35250	2.2282	0.7511	0.7576	0.7543	0.8929
0.0012	412.7907	35500	1.7489	0.7971	0.7242	0.7589	0.9098
0.0002	415.6977	35750	2.0447	0.7758	0.7083	0.7405	0.9065
0.0027	418.6047	36000	1.6462	0.7682	0.7358	0.7517	0.9161
0.001	421.5116	36250	0.6546	0.7925	0.7315	0.7608	0.9351
0.0042	424.4186	36500	0.9730	0.7958	0.7692	0.7823	0.9123
0.0005	427.3256	36750	1.6119	0.7687	0.7475	0.7579	0.9038
0.0001	430.2326	37000	0.9209	0.7627	0.7417	0.7520	0.9168
0.0006	433.1395	37250	1.0662	0.8152	0.7808	0.7976	0.9224
0.0	436.0465	37500	0.8619	0.8067	0.7634	0.7845	0.9254
0.0	438.9535	37750	0.8615	0.8149	0.7605	0.7868	0.9275
0.0	441.8605	38000	0.8724	0.8476	0.7591	0.8009	0.9217
0.0003	444.7674	38250	0.9480	0.7820	0.7547	0.7681	0.9117
0.0006	447.6744	38500	2.2429	0.7582	0.6691	0.7109	0.8909
0.0002	450.5814	38750	3.1912	0.7389	0.6284	0.6792	0.8802
0.0038	453.4884	39000	2.9375	0.7964	0.7721	0.7841	0.9014
0.001	456.3953	39250	2.8527	0.7831	0.7547	0.7687	0.9108
0.0	459.3023	39500	2.9475	0.7761	0.7344	0.7547	0.8974
0.0004	462.2093	39750	2.5123	0.7931	0.7620	0.7772	0.9092
0.0001	465.1163	40000	2.7735	0.7718	0.7460	0.7587	0.8971
0.0002	468.0233	40250	2.5121	0.7797	0.7910	0.7853	0.8955
0.0004	470.9302	40500	2.5540	0.7415	0.7576	0.7495	0.8944
0.0011	473.8372	40750	2.3348	0.7767	0.7271	0.7511	0.8663
0.0004	476.7442	41000	1.3613	0.8128	0.7562	0.7835	0.8910
0.0019	479.6512	41250	3.2104	0.7794	0.7591	0.7691	0.8806
0.0006	482.5581	41500	2.4848	0.7839	0.7634	0.7735	0.8750
0.0036	485.4651	41750	2.3819	0.7960	0.7533	0.7740	0.8807
0.0	488.3721	42000	2.4729	0.7783	0.7591	0.7686	0.8789
0.0022	491.2791	42250	2.6079	0.7846	0.7823	0.7834	0.8640
0.0003	494.1860	42500	2.9443	0.7525	0.7721	0.7622	0.8852
0.0004	497.0930	42750	1.6797	0.7585	0.7794	0.7688	0.8942
0.0001	500.0	43000	2.2419	0.7896	0.7242	0.7555	0.8944
0.0004	502.9070	43250	1.0526	0.7912	0.7808	0.7860	0.9093
0.0002	505.8140	43500	1.1294	0.8064	0.8099	0.8081	0.9166
0.0004	508.7209	43750	1.0399	0.8419	0.8041	0.8226	0.9119
0.0009	511.6279	44000	3.2159	0.7728	0.7010	0.7352	0.8757
0.0	514.5349	44250	3.1892	0.7769	0.7025	0.7378	0.8784
0.0002	517.4419	44500	3.0482	0.7669	0.7402	0.7533	0.8792
0.0032	520.3488	44750	2.2964	0.7954	0.7504	0.7722	0.8913
0.0001	523.2558	45000	2.4701	0.7470	0.7199	0.7332	0.8875
0.0	526.1628	45250	2.4565	0.7714	0.7591	0.7652	0.8864
0.0	529.0698	45500	2.5875	0.7753	0.7562	0.7656	0.8862
0.0	531.9767	45750	2.6570	0.7753	0.7562	0.7656	0.8861
0.0	534.8837	46000	2.7049	0.7753	0.7562	0.7656	0.8864
0.0	537.7907	46250	2.7459	0.7768	0.7576	0.7671	0.8865
0.0	540.6977	46500	2.7788	0.7776	0.7562	0.7667	0.8862
0.0012	543.6047	46750	2.7625	0.7898	0.7852	0.7875	0.8721
0.0008	546.5116	47000	2.3143	0.7997	0.7184	0.7569	0.8981
0.0	549.4186	47250	2.4899	0.7910	0.7910	0.7910	0.9048
0.0	552.3256	47500	2.2084	0.7915	0.7823	0.7869	0.9080
0.0	555.2326	47750	2.2190	0.7895	0.7837	0.7866	0.9084
0.0	558.1395	48000	2.1930	0.7913	0.7431	0.7665	0.9061
0.0	561.0465	48250	2.4797	0.7439	0.7083	0.7257	0.8844
0.0001	563.9535	48500	2.1903	0.8054	0.7388	0.7706	0.8981
0.0001	566.8605	48750	2.1965	0.8094	0.7765	0.7926	0.8938
0.0001	569.7674	49000	2.8300	0.8212	0.7866	0.8036	0.9067
0.0001	572.6744	49250	2.7412	0.7779	0.7779	0.7779	0.8828
0.0	575.5814	49500	3.0728	0.75	0.7184	0.7339	0.8699
0.0	578.4884	49750	3.1400	0.7740	0.7504	0.7620	0.8819
0.0	581.3953	50000	3.1239	0.7825	0.7518	0.7668	0.8825
0.0	584.3023	50250	3.0685	0.8066	0.7446	0.7743	0.8835
0.0	587.2093	50500	3.1154	0.8070	0.7402	0.7721	0.8839
0.0006	590.1163	50750	1.6165	0.7968	0.7910	0.7939	0.8761
0.0179	593.0233	51000	2.8769	0.8098	0.7663	0.7875	0.8972
0.0003	595.9302	51250	3.2400	0.7846	0.7242	0.7532	0.8850
0.0	598.8372	51500	3.1445	0.7988	0.8012	0.8000	0.8830
0.0001	601.7442	51750	3.0073	0.7925	0.7649	0.7784	0.8931
0.0001	604.6512	52000	2.6066	0.7851	0.7475	0.7658	0.8847
0.0	607.5581	52250	2.7908	0.8110	0.7721	0.7911	0.8896
0.0	610.4651	52500	2.8721	0.7986	0.6851	0.7375	0.8927
0.0	613.3721	52750	2.9075	0.8023	0.7010	0.7483	0.8940
0.0	616.2791	53000	2.9256	0.8125	0.7170	0.7618	0.8953
0.0	619.1860	53250	2.9412	0.8032	0.7228	0.7609	0.8956
0.0005	622.0930	53500	3.0940	0.7756	0.7025	0.7372	0.8958
0.0003	625.0	53750	3.0351	0.7870	0.7025	0.7423	0.8945
0.0	627.9070	54000	3.0699	0.7902	0.6996	0.7421	0.8968
0.0	630.8140	54250	3.0875	0.7905	0.7010	0.7431	0.8968
0.0	633.7209	54500	3.1075	0.7902	0.6996	0.7421	0.8967
0.0	636.6279	54750	3.0571	0.7877	0.7054	0.7443	0.8971
0.0	639.5349	55000	3.0949	0.7905	0.7010	0.7431	0.8968
0.0	642.4419	55250	3.1625	0.7942	0.7112	0.7504	0.9000
0.0	645.3488	55500	3.1741	0.7913	0.7097	0.7483	0.8999
0.0004	648.2558	55750	3.2423	0.7776	0.7562	0.7667	0.9054
0.0	651.1628	56000	3.2139	0.7749	0.7692	0.7720	0.9066
0.0003	654.0698	56250	3.1129	0.7866	0.7649	0.7756	0.8897
0.0	656.9767	56500	3.2193	0.7751	0.7605	0.7678	0.8924
0.0	659.8837	56750	3.2583	0.7877	0.7649	0.7761	0.8984
0.0	662.7907	57000	3.2903	0.7842	0.7649	0.7744	0.8996
0.0	665.6977	57250	3.3166	0.7634	0.7634	0.7634	0.8972
0.0003	668.6047	57500	3.2849	0.7605	0.7329	0.7465	0.8900
0.0001	671.5116	57750	3.1850	0.7683	0.7460	0.7570	0.8920
0.0	674.4186	58000	3.2246	0.7850	0.7736	0.7792	0.8956
0.0	677.3256	58250	3.2654	0.7875	0.7692	0.7783	0.8977
0.0	680.2326	58500	3.2799	0.7789	0.7620	0.7704	0.9016
0.0	683.1395	58750	3.2765	0.7755	0.7620	0.7687	0.9011
0.0	686.0465	59000	3.2973	0.7824	0.7620	0.7721	0.8959
0.0	688.9535	59250	3.3266	0.7789	0.7620	0.7704	0.9016
0.0	691.8605	59500	3.3429	0.7788	0.7562	0.7673	0.9012
0.0	694.7674	59750	3.3258	0.7865	0.7591	0.7725	0.8972
0.0	697.6744	60000	3.3333	0.7826	0.7576	0.7699	0.8971
0.0	700.5814	60250	3.3470	0.7814	0.7576	0.7693	0.8971
0.0	703.4884	60500	3.3615	0.7758	0.7533	0.7644	0.9008
0.0003	706.3953	60750	3.4198	0.7560	0.7779	0.7668	0.8817
0.0021	709.3023	61000	2.8619	0.7779	0.7576	0.7676	0.8953
0.0	712.2093	61250	2.9437	0.7778	0.7823	0.7800	0.8944
0.0	715.1163	61500	2.9703	0.7746	0.7779	0.7762	0.8949
0.0	718.0233	61750	2.9748	0.7820	0.7808	0.7814	0.8949
0.0	720.9302	62000	3.0192	0.7852	0.7692	0.7771	0.8972
0.0	723.8372	62250	3.0896	0.7829	0.7591	0.7708	0.8968
0.0	726.7442	62500	3.1466	0.7865	0.7591	0.7725	0.8959
0.0	729.6512	62750	3.1765	0.7725	0.7837	0.7781	0.8959
0.0	732.5581	63000	3.0951	0.7722	0.7576	0.7648	0.9009
0.0001	735.4651	63250	2.7714	0.7859	0.7939	0.7899	0.9016
0.0	738.3721	63500	2.9707	0.7843	0.7808	0.7825	0.8973
0.0003	741.2791	63750	3.5840	0.8129	0.7881	0.8003	0.9000
0.0015	744.1860	64000	2.9799	0.7786	0.8012	0.7897	0.8692
0.0007	747.0930	64250	2.8935	0.7896	0.7954	0.7925	0.8763
0.0	750.0	64500	2.8934	0.7786	0.7910	0.7847	0.8835
0.0	752.9070	64750	2.9214	0.7832	0.7866	0.7849	0.8861
0.0	755.8140	65000	2.9522	0.7888	0.7750	0.7818	0.8859
0.0002	758.7209	65250	3.3635	0.7997	0.7881	0.7939	0.8909
0.0	761.6279	65500	3.1261	0.8003	0.8084	0.8043	0.8941
0.0	764.5349	65750	3.2127	0.7747	0.7286	0.7509	0.8910
0.0	767.4419	66000	3.1459	0.7868	0.7286	0.7566	0.8986
0.0	770.3488	66250	2.7623	0.7872	0.7837	0.7855	0.9026
0.0001	773.2558	66500	2.8329	0.8059	0.8258	0.8158	0.9009
0.0	776.1628	66750	3.2027	0.7872	0.7678	0.7774	0.8954
0.0	779.0698	67000	3.2114	0.7872	0.7678	0.7774	0.8954
0.0	781.9767	67250	3.3349	0.7968	0.7852	0.7909	0.8918
0.0	784.8837	67500	3.4000	0.7901	0.8084	0.7991	0.8871
0.0	787.7907	67750	3.5193	0.7947	0.7417	0.7673	0.8909
0.0	790.6977	68000	3.5233	0.7947	0.7417	0.7673	0.8909
0.0	793.6047	68250	3.5219	0.7957	0.7518	0.7731	0.8918
0.0	796.5116	68500	3.5251	0.7957	0.7518	0.7731	0.8918
0.0	799.4186	68750	3.5291	0.7994	0.7576	0.7779	0.8923
0.0	802.3256	69000	3.5358	0.7991	0.7562	0.7770	0.8922
0.0	805.2326	69250	3.5450	0.7991	0.7562	0.7770	0.8922
0.0	808.1395	69500	3.7319	0.8018	0.7576	0.7791	0.8941
0.0	811.0465	69750	3.7416	0.8018	0.7576	0.7791	0.8941
0.0	813.9535	70000	3.7389	0.8009	0.7417	0.7702	0.8928
0.0	816.8605	70250	3.7488	0.8009	0.7417	0.7702	0.8928
0.0	819.7674	70500	3.7659	0.7956	0.7402	0.7669	0.8924
0.0001	822.6744	70750	3.8653	0.7894	0.7344	0.7609	0.8901
0.0	825.5814	71000	3.8697	0.7935	0.7417	0.7667	0.8913
0.0003	828.4884	71250	3.8570	0.8072	0.7533	0.7793	0.8915
0.0011	831.3953	71500	3.7540	0.8006	0.7576	0.7785	0.8962
0.0	834.3023	71750	3.7660	0.7982	0.7576	0.7774	0.8958
0.0	837.2093	72000	3.7739	0.7982	0.7576	0.7774	0.8958
0.0	840.1163	72250	3.7825	0.8006	0.7576	0.7785	0.8956
0.0004	843.0233	72500	3.5740	0.7919	0.7620	0.7766	0.8950
0.0	845.9302	72750	3.4904	0.7845	0.7504	0.7671	0.8986
0.0	848.8372	73000	3.5023	0.7924	0.7591	0.7754	0.9012
0.0	851.7442	73250	3.5040	0.8169	0.7576	0.7861	0.9034
0.0	854.6512	73500	3.4600	0.8037	0.7663	0.7845	0.9008
0.0	857.5581	73750	3.4825	0.8040	0.7678	0.7854	0.9005
0.0	860.4651	74000	3.4958	0.8040	0.7678	0.7854	0.9008
0.0	863.3721	74250	3.4355	0.7931	0.7678	0.7802	0.9023
0.0	866.2791	74500	3.6559	0.8073	0.7417	0.7731	0.9018
0.0001	869.1860	74750	3.3817	0.7883	0.7620	0.7749	0.9039
0.0001	872.0930	75000	3.4859	0.7976	0.7663	0.7816	0.9029
0.0	875.0	75250	3.5278	0.7997	0.7591	0.7789	0.9039
0.0	877.9070	75500	3.5331	0.7973	0.7591	0.7777	0.9040
0.0001	880.8140	75750	3.2685	0.8129	0.7692	0.7905	0.9039
0.0	883.7209	76000	3.3447	0.8040	0.7620	0.7824	0.9047
0.0	886.6279	76250	3.4697	0.7877	0.7431	0.7647	0.9070
0.0	889.5349	76500	3.5728	0.7832	0.7446	0.7634	0.8955
0.0	892.4419	76750	3.5972	0.7781	0.7431	0.7602	0.8964
0.0	895.3488	77000	3.6058	0.7781	0.7431	0.7602	0.8964
0.0	898.2558	77250	3.6814	0.8086	0.7358	0.7705	0.9025
0.0	901.1628	77500	3.6851	0.8089	0.7373	0.7715	0.9021
0.0	904.0698	77750	3.6505	0.8148	0.7852	0.7997	0.9044
0.0	906.9767	78000	3.6553	0.8212	0.7997	0.8103	0.9056
0.0	909.8837	78250	3.6650	0.8206	0.7968	0.8085	0.9053
0.0	912.7907	78500	3.6698	0.8191	0.7954	0.8071	0.9052
0.0	915.6977	78750	3.6742	0.8185	0.7983	0.8082	0.9054
0.0	918.6047	79000	3.6748	0.8151	0.7997	0.8073	0.9051
0.0	921.5116	79250	3.6843	0.8214	0.8012	0.8112	0.9053
0.0	924.4186	79500	3.7639	0.8084	0.7779	0.7929	0.9052
0.0	927.3256	79750	3.7661	0.8072	0.7779	0.7923	0.9051
0.0	930.2326	80000	3.7678	0.8069	0.7765	0.7914	0.9051
0.0001	933.1395	80250	3.7706	0.8079	0.7750	0.7911	0.9049
0.0	936.0465	80500	3.7542	0.8027	0.7852	0.7938	0.9051
0.0	938.9535	80750	3.7570	0.8024	0.7837	0.7930	0.9048
0.0	941.8605	81000	3.8219	0.8115	0.7808	0.7959	0.9053
0.0	944.7674	81250	3.8233	0.8115	0.7808	0.7959	0.9054
0.0	947.6744	81500	3.8411	0.8130	0.7823	0.7973	0.9040
0.0	950.5814	81750	3.9238	0.8128	0.7750	0.7935	0.9030
0.0001	953.4884	82000	3.8736	0.8037	0.7547	0.7784	0.8991
0.0	956.3953	82250	3.8652	0.8059	0.7591	0.7818	0.8986
0.0	959.3023	82500	3.8061	0.8194	0.7968	0.8079	0.9030
0.0	962.2093	82750	3.8084	0.8194	0.7968	0.8079	0.9030
0.0	965.1163	83000	3.8098	0.8194	0.7968	0.8079	0.9030
0.0	968.0233	83250	3.8177	0.8080	0.7939	0.8009	0.9047
0.0	970.9302	83500	3.7951	0.8043	0.8055	0.8049	0.8924
0.0	973.8372	83750	3.8099	0.8052	0.8041	0.8046	0.8946
0.0	976.7442	84000	3.8828	0.8085	0.7968	0.8026	0.8984
0.002	979.6512	84250	3.6594	0.7885	0.7954	0.7919	0.8875
0.0003	982.5581	84500	4.0580	0.8059	0.7896	0.7977	0.9005
0.0	985.4651	84750	4.0887	0.8148	0.7852	0.7997	0.8991
0.0002	988.3721	85000	3.7046	0.8014	0.8026	0.8020	0.8935
0.0	991.2791	85250	3.7061	0.8012	0.8012	0.8012	0.8933
0.0	994.1860	85500	3.7099	0.8058	0.8012	0.8035	0.8933
0.0	997.0930	85750	3.7580	0.8071	0.7954	0.8012	0.8911
0.0	1000.0	86000	3.8575	0.7940	0.7663	0.7799	0.8896
0.0	1002.9070	86250	3.8635	0.7937	0.7649	0.7790	0.8904
0.0	1005.8140	86500	3.8553	0.7988	0.7663	0.7822	0.8898
0.0	1008.7209	86750	3.8568	0.7988	0.7663	0.7822	0.8898
0.0	1011.6279	87000	3.8584	0.7988	0.7663	0.7822	0.8898
0.0	1014.5349	87250	3.8611	0.7988	0.7663	0.7822	0.8898
0.0	1017.4419	87500	3.8632	0.7973	0.7649	0.7807	0.8897
0.0	1020.3488	87750	3.8605	0.8033	0.7707	0.7867	0.8900
0.0	1023.2558	88000	3.8612	0.8021	0.7707	0.7861	0.8900
0.0	1026.1628	88250	3.8685	0.8045	0.7707	0.7872	0.8907
0.0	1029.0698	88500	3.8365	0.7929	0.7779	0.7853	0.9017
0.0	1031.9767	88750	3.8527	0.7914	0.7765	0.7839	0.9008
0.0	1034.8837	89000	3.8541	0.7888	0.7750	0.7818	0.9008
0.0	1037.7907	89250	3.8419	0.7988	0.7779	0.7882	0.9047
0.0	1040.6977	89500	3.8427	0.7926	0.7765	0.7845	0.9044
0.0	1043.6047	89750	3.8432	0.7926	0.7765	0.7845	0.9044
0.0	1046.5116	90000	3.8440	0.7926	0.7765	0.7845	0.9044
0.0	1049.4186	90250	3.8462	0.7938	0.7765	0.7850	0.9023
0.0	1052.3256	90500	3.8465	0.7938	0.7765	0.7850	0.9023
0.0	1055.2326	90750	3.8472	0.7949	0.7765	0.7856	0.9025
0.0001	1058.1395	91000	3.8464	0.8139	0.7808	0.7970	0.9052
0.0	1061.0465	91250	3.8468	0.8139	0.7808	0.7970	0.9052
0.0	1063.9535	91500	3.8477	0.8139	0.7808	0.7970	0.9052
0.0	1066.8605	91750	3.8685	0.8084	0.7837	0.7959	0.9023
0.0002	1069.7674	92000	3.7892	0.7915	0.7823	0.7869	0.8967
0.0	1072.6744	92250	3.7899	0.7926	0.7823	0.7874	0.8968
0.0	1075.5814	92500	3.7997	0.8018	0.7866	0.7941	0.9026
0.0	1078.4884	92750	3.8000	0.8018	0.7866	0.7941	0.9026
0.0	1081.3953	93000	3.8006	0.8018	0.7866	0.7941	0.9026
0.0	1084.3023	93250	3.8011	0.8018	0.7866	0.7941	0.9026
0.0001	1087.2093	93500	3.8010	0.8018	0.7866	0.7941	0.9026
0.0	1090.1163	93750	3.8195	0.8018	0.7866	0.7941	0.9026
0.0	1093.0233	94000	3.8251	0.8068	0.7881	0.7974	0.9035
0.0	1095.9302	94250	3.8254	0.8068	0.7881	0.7974	0.9035
0.0	1098.8372	94500	3.8260	0.8068	0.7881	0.7974	0.9035
0.0	1101.7442	94750	3.8264	0.8068	0.7881	0.7974	0.9035
0.0	1104.6512	95000	3.8334	0.8104	0.7881	0.7991	0.9036
0.0	1107.5581	95250	3.8338	0.8104	0.7881	0.7991	0.9036
0.0	1110.4651	95500	3.8344	0.8104	0.7881	0.7991	0.9036
0.0	1113.3721	95750	3.8351	0.8104	0.7881	0.7991	0.9036
0.0	1116.2791	96000	3.8088	0.8015	0.7852	0.7933	0.9014
0.0	1119.1860	96250	3.8092	0.8015	0.7852	0.7933	0.9014
0.0	1122.0930	96500	3.8098	0.8015	0.7852	0.7933	0.9014
0.0	1125.0	96750	3.8148	0.7834	0.7823	0.7829	0.8981
0.0	1127.9070	97000	3.8149	0.7812	0.7823	0.7817	0.8982
0.0	1130.8140	97250	3.8156	0.7834	0.7823	0.7829	0.8981
0.0	1133.7209	97500	3.8157	0.7812	0.7823	0.7817	0.8982
0.0	1136.6279	97750	3.8164	0.7812	0.7823	0.7817	0.8982
0.0	1139.5349	98000	3.8169	0.7834	0.7823	0.7829	0.8981
0.0	1142.4419	98250	3.8170	0.7812	0.7823	0.7817	0.8982
0.0	1145.3488	98500	3.8176	0.7812	0.7823	0.7817	0.8982
0.0	1148.2558	98750	3.8179	0.7812	0.7823	0.7817	0.8982
0.0	1151.1628	99000	3.8181	0.7812	0.7823	0.7817	0.8982
0.0	1154.0698	99250	3.8183	0.7812	0.7823	0.7817	0.8982
0.0	1156.9767	99500	3.8184	0.7812	0.7823	0.7817	0.8982
0.0	1159.8837	99750	3.8152	0.7755	0.7823	0.7789	0.8985
0.0	1162.7907	100000	3.8153	0.7755	0.7823	0.7789	0.8985

Framework versions

• Transformers 4.51.3
• Pytorch 2.4.1
• Datasets 3.6.0
• Tokenizers 0.21.1