run_20240607194341

This model is a fine-tuned version of bert-base-multilingual-cased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.3850
• Precision: 0.6661
• Recall: 0.6895
• F1: 0.6776
• Number: 246054
• Ageno Precision: 0.8887
• Ageno Recall: 0.8671
• Ageno F1: 0.8778
• Ageno Number: 8098
• Ank Account/bic Precision: 0.9272
• Ank Account/bic Recall: 0.9439
• Ank Account/bic F1: 0.9355
• Ank Account/bic Number: 41279
• Ank Account/iban Precision: 0.9102
• Ank Account/iban Recall: 0.9664
• Ank Account/iban F1: 0.9375
• Ank Account/iban Number: 83205
• Ank Account/bankinfo Precision: 0.7705
• Ank Account/bankinfo Recall: 0.8284
• Ank Account/bankinfo F1: 0.7984
• Ank Account/bankinfo Number: 35943
• Ank Account/currencycode Precision: 0.0756
• Ank Account/currencycode Recall: 0.0328
• Ank Account/currencycode F1: 0.0458
• Ank Account/currencycode Number: 944
• Ardnumber Precision: 0.5415
• Ardnumber Recall: 0.4866
• Ardnumber F1: 0.5126
• Ardnumber Number: 1422
• Ardtype Precision: 0.6363
• Ardtype Recall: 0.6275
• Ardtype F1: 0.6319
• Ardtype Number: 4156
• Axamount Precision: 0.7324
• Axamount Recall: 0.7659
• Axamount F1: 0.7488
• Axamount Number: 6198
• Eservationnumber Precision: 0.5093
• Eservationnumber Recall: 0.4991
• Eservationnumber F1: 0.5041
• Eservationnumber Number: 2755
• Etamount Precision: 0.7453
• Etamount Recall: 0.7619
• Etamount F1: 0.7535
• Etamount Number: 7164
• Heckin Precision: 0.9169
• Heckin Recall: 0.9232
• Heckin F1: 0.9200
• Heckin Number: 15446
• Heckout Precision: 0.8890
• Heckout Recall: 0.8882
• Heckout F1: 0.8886
• Heckout Number: 15381
• Nvoicedate Precision: 0.8887
• Nvoicedate Recall: 0.8997
• Nvoicedate F1: 0.8941
• Nvoicedate Number: 16582
• Nvoicenumber Precision: 0.8900
• Nvoicenumber Recall: 0.9137
• Nvoicenumber F1: 0.9017
• Nvoicenumber Number: 16194
• Ocumenttype Precision: 0.8256
• Ocumenttype Recall: 0.8475
• Ocumenttype F1: 0.8364
• Ocumenttype Number: 15432
• Ompanyaddress Precision: 0.8742
• Ompanyaddress Recall: 0.8973
• Ompanyaddress F1: 0.8856
• Ompanyaddress Number: 16505
• Ompanycity Precision: 0.8498
• Ompanycity Recall: 0.8760
• Ompanycity F1: 0.8627
• Ompanycity Number: 16111
• Ompanycountry Precision: 0.8579
• Ompanycountry Recall: 0.8794
• Ompanycountry F1: 0.8685
• Ompanycountry Number: 9728
• Ompanyname Precision: 0.8319
• Ompanyname Recall: 0.8562
• Ompanyname F1: 0.8439
• Ompanyname Number: 16413
• Ompanyvatnumber Precision: 0.6078
• Ompanyvatnumber Recall: 0.6757
• Ompanyvatnumber F1: 0.6399
• Ompanyvatnumber Number: 3568
• Ompanyzipcode Precision: 0.9190
• Ompanyzipcode Recall: 0.9484
• Ompanyzipcode F1: 0.9334
• Ompanyzipcode Number: 16068
• Ookingnumber Precision: 0.3472
• Ookingnumber Recall: 0.3772
• Ookingnumber F1: 0.3616
• Ookingnumber Number: 1787
• Oomno Precision: 0.8658
• Oomno Recall: 0.9156
• Oomno F1: 0.8900
• Oomno Number: 13109
• Oteladdress Precision: 0.6676
• Oteladdress Recall: 0.6892
• Oteladdress F1: 0.6782
• Oteladdress Number: 15864
• Otelbankaccount Precision: 0.0
• Otelbankaccount Recall: 0.0
• Otelbankaccount F1: 0.0
• Otelbankaccount Number: 59
• Otelcity Precision: 0.7466
• Otelcity Recall: 0.7705
• Otelcity F1: 0.7583
• Otelcity Number: 15560
• Otelcountry Precision: 0.7517
• Otelcountry Recall: 0.7487
• Otelcountry F1: 0.7502
• Otelcountry Number: 3267
• Otelemail Precision: 0.9160
• Otelemail Recall: 0.9468
• Otelemail F1: 0.9311
• Otelemail Number: 11732
• Otelfaxnumber Precision: 0.9233
• Otelfaxnumber Recall: 0.9472
• Otelfaxnumber F1: 0.9351
• Otelfaxnumber Number: 8812
• Otelname Precision: 0.5007
• Otelname Recall: 0.5155
• Otelname F1: 0.5080
• Otelname Number: 16200
• Otelphonenumber Precision: 0.9191
• Otelphonenumber Recall: 0.9497
• Otelphonenumber F1: 0.9342
• Otelphonenumber Number: 12945
• Oteltaxcode Precision: 0.3449
• Oteltaxcode Recall: 0.4228
• Oteltaxcode F1: 0.3799
• Oteltaxcode Number: 2254
• Otelvatnumber Precision: 0.7408
• Otelvatnumber Recall: 0.8187
• Otelvatnumber F1: 0.7778
• Otelvatnumber Number: 9083
• Otelzipcode Precision: 0.8675
• Otelzipcode Recall: 0.9053
• Otelzipcode F1: 0.8860
• Otelzipcode Number: 15300
• Rafficdate Precision: 0.0
• Rafficdate Recall: 0.0
• Rafficdate F1: 0.0
• Rafficdate Number: 46
• Ravellername Precision: 0.7352
• Ravellername Recall: 0.7638
• Ravellername F1: 0.7492
• Ravellername Number: 15508
• Rewtype Precision: 0.0
• Rewtype Recall: 0.0
• Rewtype F1: 0.0
• Rewtype Number: 115
• Rossamount Precision: 0.7202
• Rossamount Recall: 0.7261
• Rossamount F1: 0.7231
• Rossamount Number: 15102
• Rrivaltrainno Precision: 0.1064
• Rrivaltrainno Recall: 0.0676
• Rrivaltrainno F1: 0.0826
• Rrivaltrainno Number: 74
• Urrencycode Precision: 0.6840
• Urrencycode Recall: 0.7237
• Urrencycode F1: 0.7033
• Urrencycode Number: 10405
• Xternalreservationnumber Precision: 0.1816
• Xternalreservationnumber Recall: 0.2211
• Xternalreservationnumber F1: 0.1994
• Xternalreservationnumber Number: 579
• Overall Precision: 0.7743
• Overall Recall: 0.8020
• Overall F1: 0.7879
• Overall Accuracy: 0.9433

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 16

Training results

Training Loss	Epoch	Step	Validation Loss	Precision	Recall	F1	Number	Ageno Precision	Ageno Recall	Ageno F1	Ageno Number	Ank Account/bic Precision	Ank Account/bic Recall	Ank Account/bic F1	Ank Account/bic Number	Ank Account/iban Precision	Ank Account/iban Recall	Ank Account/iban F1	Ank Account/iban Number	Ank Account/bankinfo Precision	Ank Account/bankinfo Recall	Ank Account/bankinfo F1	Ank Account/bankinfo Number	Ank Account/currencycode Precision	Ank Account/currencycode Recall	Ank Account/currencycode F1	Ank Account/currencycode Number	Ardnumber Precision	Ardnumber Recall	Ardnumber F1	Ardnumber Number	Ardtype Precision	Ardtype Recall	Ardtype F1	Ardtype Number	Axamount Precision	Axamount Recall	Axamount F1	Axamount Number	Eservationnumber Precision	Eservationnumber Recall	Eservationnumber F1	Eservationnumber Number	Etamount Precision	Etamount Recall	Etamount F1	Etamount Number	Heckin Precision	Heckin Recall	Heckin F1	Heckin Number	Heckout Precision	Heckout Recall	Heckout F1	Heckout Number	Nvoicedate Precision	Nvoicedate Recall	Nvoicedate F1	Nvoicedate Number	Nvoicenumber Precision	Nvoicenumber Recall	Nvoicenumber F1	Nvoicenumber Number	Ocumenttype Precision	Ocumenttype Recall	Ocumenttype F1	Ocumenttype Number	Ompanyaddress Precision	Ompanyaddress Recall	Ompanyaddress F1	Ompanyaddress Number	Ompanycity Precision	Ompanycity Recall	Ompanycity F1	Ompanycity Number	Ompanycountry Precision	Ompanycountry Recall	Ompanycountry F1	Ompanycountry Number	Ompanyname Precision	Ompanyname Recall	Ompanyname F1	Ompanyname Number	Ompanyvatnumber Precision	Ompanyvatnumber Recall	Ompanyvatnumber F1	Ompanyvatnumber Number	Ompanyzipcode Precision	Ompanyzipcode Recall	Ompanyzipcode F1	Ompanyzipcode Number	Ookingnumber Precision	Ookingnumber Recall	Ookingnumber F1	Ookingnumber Number	Oomno Precision	Oomno Recall	Oomno F1	Oomno Number	Oteladdress Precision	Oteladdress Recall	Oteladdress F1	Oteladdress Number	Otelbankaccount Precision	Otelbankaccount Recall	Otelbankaccount F1	Otelbankaccount Number	Otelcity Precision	Otelcity Recall	Otelcity F1	Otelcity Number	Otelcountry Precision	Otelcountry Recall	Otelcountry F1	Otelcountry Number	Otelemail Precision	Otelemail Recall	Otelemail F1	Otelemail Number	Otelfaxnumber Precision	Otelfaxnumber Recall	Otelfaxnumber F1	Otelfaxnumber Number	Otelname Precision	Otelname Recall	Otelname F1	Otelname Number	Otelphonenumber Precision	Otelphonenumber Recall	Otelphonenumber F1	Otelphonenumber Number	Oteltaxcode Precision	Oteltaxcode Recall	Oteltaxcode F1	Oteltaxcode Number	Otelvatnumber Precision	Otelvatnumber Recall	Otelvatnumber F1	Otelvatnumber Number	Otelzipcode Precision	Otelzipcode Recall	Otelzipcode F1	Otelzipcode Number	Rafficdate Precision	Rafficdate Recall	Rafficdate F1	Rafficdate Number	Ravellername Precision	Ravellername Recall	Ravellername F1	Ravellername Number	Rewtype Precision	Rewtype Recall	Rewtype F1	Rewtype Number	Rossamount Precision	Rossamount Recall	Rossamount F1	Rossamount Number	Rrivaltrainno Precision	Rrivaltrainno Recall	Rrivaltrainno F1	Rrivaltrainno Number	Urrencycode Precision	Urrencycode Recall	Urrencycode F1	Urrencycode Number	Xternalreservationnumber Precision	Xternalreservationnumber Recall	Xternalreservationnumber F1	Xternalreservationnumber Number	Overall Precision	Overall Recall	Overall F1	Overall Accuracy
0.1162	1.0	9114	0.2088	0.6333	0.6844	0.6579	246054	0.8986	0.8533	0.8753	8098	0.9180	0.9379	0.9278	41279	0.8880	0.9821	0.9327	83205	0.7688	0.8537	0.8090	35943	0.0	0.0	0.0	944	0.6172	0.3685	0.4615	1422	0.6055	0.6475	0.6258	4156	0.6873	0.7527	0.7185	6198	0.4798	0.5746	0.5230	2755	0.6862	0.7520	0.7175	7164	0.9053	0.9232	0.9141	15446	0.8715	0.8971	0.8841	15381	0.8795	0.8877	0.8836	16582	0.8708	0.9215	0.8954	16194	0.7942	0.8691	0.8300	15432	0.8696	0.8948	0.8820	16505	0.8336	0.8684	0.8506	16111	0.8501	0.8633	0.8566	9728	0.8238	0.8551	0.8392	16413	0.5906	0.8133	0.6843	3568	0.9056	0.9450	0.9249	16068	0.3737	0.3951	0.3841	1787	0.8421	0.9153	0.8772	13109	0.6549	0.7306	0.6907	15864	0.0	0.0	0.0	59	0.6877	0.7735	0.7281	15560	0.7089	0.7493	0.7286	3267	0.9065	0.9535	0.9294	11732	0.9048	0.9452	0.9246	8812	0.4366	0.4907	0.4621	16200	0.8900	0.9564	0.9220	12945	0.2858	0.6619	0.3993	2254	0.6772	0.8594	0.7575	9083	0.8367	0.9071	0.8705	15300	0.0	0.0	0.0	46	0.6981	0.7784	0.7361	15508	0.0	0.0	0.0	115	0.6645	0.6821	0.6732	15102	0.0	0.0	0.0	74	0.6561	0.7785	0.7121	10405	0.1805	0.2176	0.1973	579	0.7458	0.8054	0.7745	0.9400
0.0866	2.0	18228	0.2108	0.6539	0.6881	0.6706	246054	0.8636	0.8798	0.8717	8098	0.9214	0.9558	0.9383	41279	0.8998	0.9745	0.9357	83205	0.7674	0.8362	0.8003	35943	0.0349	0.0095	0.0150	944	0.5165	0.5281	0.5223	1422	0.6080	0.7002	0.6509	4156	0.7173	0.7723	0.7438	6198	0.5395	0.5408	0.5401	2755	0.7174	0.7688	0.7422	7164	0.9002	0.9307	0.9152	15446	0.8790	0.8878	0.8834	15381	0.8757	0.8959	0.8856	16582	0.8791	0.9145	0.8965	16194	0.8074	0.8683	0.8367	15432	0.8741	0.9031	0.8883	16505	0.8434	0.8798	0.8612	16111	0.8359	0.8858	0.8601	9728	0.8221	0.8625	0.8419	16413	0.5991	0.7685	0.6733	3568	0.9128	0.9483	0.9302	16068	0.4155	0.3772	0.3954	1787	0.8704	0.9037	0.8867	13109	0.6605	0.7028	0.6810	15864	0.0	0.0	0.0	59	0.7259	0.7758	0.7500	15560	0.7600	0.7463	0.7531	3267	0.9153	0.9498	0.9322	11732	0.9210	0.9453	0.9330	8812	0.4725	0.4962	0.4841	16200	0.9200	0.9513	0.9354	12945	0.3127	0.3909	0.3475	2254	0.7181	0.8300	0.7700	9083	0.8500	0.9030	0.8757	15300	0.0	0.0	0.0	46	0.7260	0.7697	0.7472	15508	0.0	0.0	0.0	115	0.6948	0.7300	0.7120	15102	0.0	0.0	0.0	74	0.6676	0.7853	0.7217	10405	0.2284	0.2418	0.2349	579	0.7632	0.8065	0.7842	0.9424
0.0692	3.0	27342	0.2266	0.6547	0.6854	0.6697	246054	0.8782	0.8765	0.8774	8098	0.9030	0.9644	0.9327	41279	0.8944	0.9810	0.9357	83205	0.7494	0.8853	0.8117	35943	0.0084	0.0032	0.0046	944	0.5492	0.5970	0.5721	1422	0.5719	0.6855	0.6236	4156	0.7064	0.7389	0.7223	6198	0.5107	0.4421	0.4739	2755	0.7415	0.7531	0.7472	7164	0.9201	0.9156	0.9179	15446	0.8914	0.8877	0.8895	15381	0.8918	0.9003	0.8960	16582	0.8689	0.9182	0.8929	16194	0.8124	0.8574	0.8343	15432	0.8751	0.9055	0.8900	16505	0.8402	0.8843	0.8617	16111	0.8537	0.8932	0.8730	9728	0.8338	0.8624	0.8479	16413	0.5933	0.7576	0.6654	3568	0.9125	0.9505	0.9311	16068	0.3688	0.4287	0.3965	1787	0.8558	0.9174	0.8855	13109	0.6734	0.6891	0.6812	15864	0.0	0.0	0.0	59	0.7381	0.7544	0.7462	15560	0.7630	0.7518	0.7573	3267	0.9163	0.9466	0.9312	11732	0.9253	0.9446	0.9349	8812	0.4642	0.5004	0.4816	16200	0.9203	0.9541	0.9369	12945	0.3122	0.3886	0.3462	2254	0.7312	0.8013	0.7647	9083	0.8552	0.8911	0.8728	15300	0.0	0.0	0.0	46	0.7311	0.7639	0.7471	15508	0.0	0.0	0.0	115	0.7163	0.7083	0.7123	15102	0.0	0.0	0.0	74	0.6816	0.7336	0.7067	10405	0.1930	0.3316	0.2440	579	0.7633	0.8062	0.7841	0.9418
0.0606	4.0	36456	0.2397	0.6570	0.6944	0.6752	246054	0.8740	0.8794	0.8766	8098	0.9189	0.9596	0.9388	41279	0.8973	0.9667	0.9307	83205	0.7601	0.8346	0.7956	35943	0.025	0.0085	0.0127	944	0.5180	0.4241	0.4664	1422	0.6070	0.6574	0.6312	4156	0.7112	0.7853	0.7464	6198	0.5478	0.4740	0.5083	2755	0.7301	0.7654	0.7473	7164	0.9139	0.9324	0.9231	15446	0.8919	0.8988	0.8954	15381	0.8853	0.9115	0.8982	16582	0.8824	0.9156	0.8987	16194	0.8002	0.8810	0.8387	15432	0.8792	0.9018	0.8904	16505	0.8511	0.8808	0.8657	16111	0.8567	0.8904	0.8732	9728	0.8273	0.8551	0.8410	16413	0.6027	0.7458	0.6667	3568	0.9195	0.9472	0.9331	16068	0.3657	0.4589	0.4070	1787	0.8629	0.9217	0.8913	13109	0.6524	0.7017	0.6762	15864	0.0	0.0	0.0	59	0.7283	0.7567	0.7422	15560	0.7619	0.7600	0.7610	3267	0.9148	0.9503	0.9322	11732	0.9230	0.9493	0.9359	8812	0.4869	0.5286	0.5069	16200	0.9152	0.9530	0.9337	12945	0.3334	0.4539	0.3844	2254	0.7330	0.8123	0.7706	9083	0.8537	0.9090	0.8805	15300	0.0	0.0	0.0	46	0.7321	0.7432	0.7376	15508	0.0	0.0	0.0	115	0.7010	0.7230	0.7118	15102	0.0	0.0	0.0	74	0.6577	0.8179	0.7291	10405	0.1920	0.1813	0.1865	579	0.7647	0.8086	0.7860	0.9429
0.051	5.0	45570	0.2506	0.6647	0.6816	0.6730	246054	0.8970	0.8735	0.8851	8098	0.9271	0.9398	0.9334	41279	0.9087	0.9605	0.9338	83205	0.7787	0.8121	0.7951	35943	0.0139	0.0042	0.0065	944	0.5814	0.4297	0.4941	1422	0.6127	0.6574	0.6342	4156	0.7363	0.7446	0.7404	6198	0.5213	0.4980	0.5094	2755	0.7448	0.7383	0.7415	7164	0.9160	0.9222	0.9191	15446	0.8950	0.8882	0.8916	15381	0.8916	0.9046	0.8980	16582	0.8868	0.9128	0.8996	16194	0.8134	0.8656	0.8387	15432	0.8785	0.9004	0.8893	16505	0.8539	0.8780	0.8658	16111	0.8687	0.8815	0.8750	9728	0.8369	0.8616	0.8491	16413	0.6162	0.6620	0.6383	3568	0.9203	0.9465	0.9332	16068	0.3342	0.4169	0.3710	1787	0.8799	0.9051	0.8923	13109	0.6729	0.6895	0.6811	15864	0.0	0.0	0.0	59	0.7303	0.7854	0.7568	15560	0.7459	0.7600	0.7529	3267	0.9169	0.9474	0.9319	11732	0.9232	0.9543	0.9385	8812	0.4843	0.4960	0.4901	16200	0.9154	0.9523	0.9335	12945	0.3239	0.3563	0.3393	2254	0.7556	0.7797	0.7674	9083	0.8547	0.9114	0.8822	15300	0.0	0.0	0.0	46	0.7379	0.7539	0.7458	15508	0.0	0.0	0.0	115	0.7240	0.7179	0.7209	15102	0.0	0.0	0.0	74	0.7155	0.6904	0.7027	10405	0.1454	0.0708	0.0952	579	0.7754	0.7966	0.7859	0.9431
0.0447	6.0	54684	0.2495	0.6633	0.6877	0.6753	246054	0.8548	0.8885	0.8713	8098	0.9230	0.9399	0.9314	41279	0.9020	0.9682	0.9339	83205	0.7730	0.8440	0.8070	35943	0.0329	0.0127	0.0183	944	0.5559	0.4684	0.5084	1422	0.6202	0.6193	0.6198	4156	0.7445	0.7596	0.7520	6198	0.5181	0.5031	0.5105	2755	0.7399	0.7654	0.7524	7164	0.9164	0.9270	0.9217	15446	0.8886	0.8981	0.8933	15381	0.8980	0.9050	0.9015	16582	0.8900	0.9161	0.9029	16194	0.8218	0.8337	0.8277	15432	0.8732	0.9034	0.8881	16505	0.8474	0.8826	0.8646	16111	0.8542	0.8821	0.8679	9728	0.8228	0.8584	0.8402	16413	0.6135	0.6522	0.6323	3568	0.9207	0.9496	0.9349	16068	0.3408	0.3509	0.3457	1787	0.8564	0.9255	0.8896	13109	0.6694	0.6965	0.6826	15864	0.0	0.0	0.0	59	0.7398	0.7777	0.7583	15560	0.7181	0.7634	0.7401	3267	0.9179	0.9481	0.9327	11732	0.9157	0.9431	0.9292	8812	0.4864	0.5125	0.4991	16200	0.9173	0.9480	0.9324	12945	0.3529	0.2742	0.3086	2254	0.7180	0.8284	0.7692	9083	0.8648	0.9033	0.8837	15300	0.0	0.0	0.0	46	0.7371	0.7642	0.7504	15508	0.0	0.0	0.0	115	0.7147	0.7126	0.7136	15102	0.0	0.0	0.0	74	0.6854	0.7648	0.7230	10405	0.1788	0.1831	0.1809	579	0.7716	0.8030	0.7870	0.9433
0.0399	7.0	63798	0.2643	0.6656	0.6938	0.6794	246054	0.8794	0.8833	0.8813	8098	0.9206	0.9599	0.9398	41279	0.9044	0.9727	0.9373	83205	0.7562	0.8773	0.8122	35943	0.0214	0.0095	0.0132	944	0.5576	0.4902	0.5217	1422	0.6277	0.6020	0.6146	4156	0.7384	0.7686	0.7532	6198	0.4870	0.5172	0.5017	2755	0.7599	0.7624	0.7611	7164	0.9191	0.9307	0.9248	15446	0.8902	0.8948	0.8925	15381	0.8884	0.9023	0.8953	16582	0.8893	0.9134	0.9012	16194	0.8187	0.8633	0.8404	15432	0.8804	0.9018	0.8910	16505	0.8488	0.8789	0.8636	16111	0.8612	0.8774	0.8692	9728	0.8251	0.8546	0.8396	16413	0.6110	0.7413	0.6699	3568	0.9143	0.9500	0.9318	16068	0.3504	0.4365	0.3887	1787	0.8628	0.9184	0.8897	13109	0.6664	0.6982	0.6819	15864	0.0	0.0	0.0	59	0.7393	0.7792	0.7587	15560	0.6872	0.7668	0.7248	3267	0.9145	0.9496	0.9318	11732	0.9238	0.9460	0.9347	8812	0.4818	0.5123	0.4966	16200	0.9243	0.9485	0.9363	12945	0.3446	0.4579	0.3932	2254	0.7438	0.8236	0.7817	9083	0.8647	0.9084	0.8860	15300	0.0	0.0	0.0	46	0.7313	0.7800	0.7548	15508	0.0	0.0	0.0	115	0.7095	0.7265	0.7179	15102	0.0	0.0	0.0	74	0.6708	0.7553	0.7106	10405	0.1680	0.1399	0.1527	579	0.7705	0.8100	0.7898	0.9432
0.0345	8.0	72912	0.2955	0.6652	0.6873	0.6761	246054	0.8719	0.8865	0.8791	8098	0.9209	0.9561	0.9382	41279	0.9064	0.9710	0.9376	83205	0.7701	0.8492	0.8077	35943	0.1113	0.0572	0.0756	944	0.5457	0.5127	0.5286	1422	0.6140	0.6583	0.6354	4156	0.7449	0.7623	0.7535	6198	0.5514	0.4515	0.4965	2755	0.7674	0.7571	0.7622	7164	0.9199	0.9029	0.9113	15446	0.8955	0.8832	0.8893	15381	0.8984	0.8998	0.8991	16582	0.8963	0.9077	0.9020	16194	0.8241	0.8527	0.8382	15432	0.8720	0.9009	0.8862	16505	0.8510	0.8775	0.8641	16111	0.8633	0.8789	0.8710	9728	0.8209	0.8586	0.8394	16413	0.6076	0.7396	0.6672	3568	0.9138	0.9495	0.9313	16068	0.3107	0.4063	0.3521	1787	0.8691	0.9152	0.8916	13109	0.6472	0.6970	0.6712	15864	0.0	0.0	0.0	59	0.7518	0.7801	0.7657	15560	0.7198	0.7594	0.7391	3267	0.9160	0.9472	0.9314	11732	0.9108	0.9464	0.9283	8812	0.4886	0.5473	0.5163	16200	0.9138	0.9504	0.9318	12945	0.3121	0.3984	0.3500	2254	0.7245	0.8151	0.7672	9083	0.8608	0.9081	0.8838	15300	0.0	0.0	0.0	46	0.7334	0.7687	0.7506	15508	0.0	0.0	0.0	115	0.7278	0.7247	0.7262	15102	0.0769	0.0270	0.04	74	0.6697	0.7658	0.7145	10405	0.1683	0.1520	0.1597	579	0.7714	0.8053	0.7880	0.9429
0.0301	9.0	82026	0.2894	0.6631	0.6859	0.6743	246054	0.8996	0.8490	0.8736	8098	0.9277	0.9452	0.9364	41279	0.9028	0.9714	0.9358	83205	0.7796	0.7911	0.7853	35943	0.0121	0.0064	0.0083	944	0.5562	0.5148	0.5347	1422	0.6209	0.5895	0.6048	4156	0.7523	0.7606	0.7564	6198	0.4884	0.5270	0.5070	2755	0.7584	0.7619	0.7601	7164	0.9140	0.9313	0.9226	15446	0.8876	0.8856	0.8866	15381	0.8930	0.8969	0.8950	16582	0.8851	0.9174	0.9009	16194	0.8197	0.8601	0.8394	15432	0.8799	0.9016	0.8906	16505	0.8518	0.8749	0.8632	16111	0.8750	0.8686	0.8718	9728	0.8342	0.8567	0.8453	16413	0.6175	0.6696	0.6425	3568	0.9206	0.9490	0.9346	16068	0.3557	0.3649	0.3602	1787	0.8679	0.9147	0.8907	13109	0.6734	0.6941	0.6836	15864	0.0	0.0	0.0	59	0.7494	0.7703	0.7597	15560	0.7722	0.7221	0.7463	3267	0.9115	0.9465	0.9287	11732	0.9219	0.9405	0.9311	8812	0.5073	0.5014	0.5043	16200	0.9162	0.9516	0.9336	12945	0.3304	0.3713	0.3497	2254	0.7294	0.8133	0.7691	9083	0.8684	0.8935	0.8807	15300	0.0	0.0	0.0	46	0.7395	0.7632	0.7511	15508	0.0	0.0	0.0	115	0.7136	0.7269	0.7202	15102	0.0811	0.0405	0.0541	74	0.6836	0.7533	0.7168	10405	0.1858	0.1848	0.1853	579	0.7741	0.7992	0.7865	0.9430
0.0271	10.0	91140	0.3139	0.6656	0.6893	0.6772	246054	0.8915	0.8656	0.8784	8098	0.9258	0.9440	0.9348	41279	0.9108	0.9688	0.9389	83205	0.7747	0.8349	0.8037	35943	0.0601	0.0201	0.0302	944	0.5597	0.4648	0.5079	1422	0.6573	0.5710	0.6111	4156	0.7223	0.7838	0.7518	6198	0.4977	0.5191	0.5082	2755	0.7518	0.7645	0.7581	7164	0.9205	0.9234	0.9220	15446	0.8885	0.8930	0.8908	15381	0.8915	0.8989	0.8952	16582	0.8876	0.9151	0.9012	16194	0.8259	0.8477	0.8367	15432	0.8790	0.8999	0.8893	16505	0.8425	0.8765	0.8592	16111	0.8590	0.8770	0.8679	9728	0.8293	0.8540	0.8414	16413	0.6096	0.6945	0.6493	3568	0.9205	0.9485	0.9343	16068	0.3540	0.3509	0.3524	1787	0.8540	0.9265	0.8887	13109	0.6619	0.7043	0.6824	15864	0.0	0.0	0.0	59	0.7353	0.7845	0.7591	15560	0.7422	0.7570	0.7495	3267	0.9188	0.9411	0.9298	11732	0.9168	0.9443	0.9303	8812	0.4949	0.5353	0.5143	16200	0.9178	0.9465	0.9320	12945	0.3313	0.3767	0.3525	2254	0.7226	0.8336	0.7742	9083	0.8651	0.9139	0.8888	15300	0.0	0.0	0.0	46	0.7354	0.7710	0.7528	15508	0.0	0.0	0.0	115	0.7141	0.7302	0.7221	15102	0.1034	0.0405	0.0583	74	0.6931	0.7102	0.7016	10405	0.2113	0.2522	0.2299	579	0.7734	0.8039	0.7883	0.9432
0.0246	11.0	100254	0.3119	0.6644	0.6919	0.6779	246054	0.8714	0.8897	0.8805	8098	0.9264	0.9428	0.9345	41279	0.9075	0.9677	0.9366	83205	0.7748	0.8259	0.7996	35943	0.0502	0.0148	0.0229	944	0.5466	0.5155	0.5306	1422	0.6319	0.6482	0.6400	4156	0.7188	0.7623	0.7400	6198	0.5212	0.4958	0.5082	2755	0.7293	0.7582	0.7435	7164	0.9165	0.9234	0.9199	15446	0.8824	0.8916	0.8870	15381	0.8891	0.9001	0.8946	16582	0.8905	0.9129	0.9016	16194	0.8295	0.8478	0.8385	15432	0.8794	0.8982	0.8887	16505	0.8463	0.8764	0.8610	16111	0.8562	0.8824	0.8691	9728	0.8351	0.8582	0.8465	16413	0.6055	0.7012	0.6499	3568	0.9204	0.9495	0.9348	16068	0.3545	0.3783	0.3660	1787	0.8694	0.9189	0.8935	13109	0.6613	0.6919	0.6762	15864	0.0	0.0	0.0	59	0.7396	0.7789	0.7587	15560	0.7382	0.7631	0.7505	3267	0.9186	0.9431	0.9307	11732	0.9231	0.9450	0.9339	8812	0.4940	0.5202	0.5068	16200	0.9217	0.9475	0.9344	12945	0.3397	0.5049	0.4061	2254	0.7248	0.8310	0.7743	9083	0.8649	0.9020	0.8831	15300	0.0	0.0	0.0	46	0.7384	0.7640	0.7510	15508	0.0	0.0	0.0	115	0.7113	0.7301	0.7206	15102	0.1429	0.0676	0.0917	74	0.6858	0.7430	0.7133	10405	0.1776	0.1917	0.1844	579	0.7720	0.8044	0.7879	0.9428
0.0222	12.0	109368	0.3398	0.6648	0.6935	0.6788	246054	0.9018	0.8712	0.8863	8098	0.9241	0.9457	0.9348	41279	0.9101	0.9619	0.9353	83205	0.7621	0.8450	0.8014	35943	0.0865	0.0360	0.0509	944	0.5501	0.5485	0.5493	1422	0.6145	0.6581	0.6355	4156	0.7424	0.7711	0.7565	6198	0.5240	0.5042	0.5139	2755	0.7563	0.7681	0.7622	7164	0.9150	0.9272	0.9210	15446	0.8864	0.8908	0.8886	15381	0.8864	0.9033	0.8948	16582	0.8890	0.9169	0.9028	16194	0.8259	0.8425	0.8342	15432	0.8802	0.9004	0.8902	16505	0.8489	0.8811	0.8647	16111	0.8561	0.8819	0.8688	9728	0.8332	0.8499	0.8415	16413	0.6011	0.6407	0.6203	3568	0.9232	0.9488	0.9359	16068	0.3408	0.3828	0.3606	1787	0.8676	0.9150	0.8907	13109	0.6561	0.6933	0.6742	15864	0.0	0.0	0.0	59	0.7416	0.7726	0.7568	15560	0.7584	0.7524	0.7554	3267	0.9142	0.9480	0.9308	11732	0.9193	0.9479	0.9334	8812	0.4924	0.5088	0.5004	16200	0.9167	0.9532	0.9346	12945	0.3398	0.4592	0.3906	2254	0.7279	0.8281	0.7748	9083	0.8663	0.9120	0.8886	15300	0.0	0.0	0.0	46	0.7339	0.7684	0.7508	15508	0.0	0.0	0.0	115	0.7209	0.7312	0.7260	15102	0.1	0.0541	0.0702	74	0.6846	0.7361	0.7094	10405	0.2153	0.2815	0.2440	579	0.7722	0.8051	0.7883	0.9431
0.0195	13.0	118482	0.3512	0.6652	0.6950	0.6798	246054	0.8864	0.8728	0.8795	8098	0.9226	0.9500	0.9361	41279	0.9085	0.9682	0.9374	83205	0.7660	0.8408	0.8017	35943	0.0658	0.0339	0.0448	944	0.5357	0.5113	0.5232	1422	0.6276	0.6451	0.6362	4156	0.7257	0.7828	0.7532	6198	0.5228	0.4744	0.4974	2755	0.7459	0.7723	0.7589	7164	0.9149	0.9321	0.9234	15446	0.8881	0.8946	0.8913	15381	0.8889	0.9059	0.8973	16582	0.8917	0.9122	0.9018	16194	0.8269	0.8506	0.8386	15432	0.8752	0.8986	0.8867	16505	0.8485	0.8782	0.8631	16111	0.8571	0.8792	0.8680	9728	0.8279	0.8569	0.8422	16413	0.6091	0.6595	0.6333	3568	0.9212	0.9498	0.9353	16068	0.3567	0.3951	0.3749	1787	0.8622	0.9212	0.8907	13109	0.6679	0.6951	0.6812	15864	0.0	0.0	0.0	59	0.7446	0.7730	0.7586	15560	0.7280	0.7603	0.7438	3267	0.9145	0.9449	0.9294	11732	0.9211	0.9475	0.9341	8812	0.4963	0.5160	0.5060	16200	0.9148	0.9491	0.9316	12945	0.3517	0.4303	0.3871	2254	0.7350	0.8253	0.7775	9083	0.8659	0.9073	0.8861	15300	0.0	0.0	0.0	46	0.7261	0.7745	0.7495	15508	0.0	0.0	0.0	115	0.7138	0.7277	0.7207	15102	0.0877	0.0676	0.0763	74	0.6598	0.7901	0.7191	10405	0.1812	0.1762	0.1786	579	0.7718	0.8074	0.7892	0.9434
0.0171	14.0	127596	0.3655	0.6678	0.6916	0.6795	246054	0.8987	0.8789	0.8887	8098	0.9242	0.9449	0.9345	41279	0.9105	0.9664	0.9376	83205	0.7701	0.8301	0.7990	35943	0.0855	0.0413	0.0557	944	0.5540	0.4726	0.5101	1422	0.6193	0.6456	0.6322	4156	0.7410	0.7691	0.7548	6198	0.5140	0.5191	0.5165	2755	0.7556	0.7598	0.7577	7164	0.9188	0.9268	0.9228	15446	0.8826	0.8875	0.8850	15381	0.8856	0.8974	0.8915	16582	0.8874	0.9180	0.9024	16194	0.8229	0.8497	0.8361	15432	0.8788	0.9000	0.8893	16505	0.8494	0.8769	0.8630	16111	0.8580	0.8786	0.8682	9728	0.8293	0.8560	0.8424	16413	0.6034	0.6754	0.6374	3568	0.9176	0.9492	0.9331	16068	0.3636	0.3811	0.3721	1787	0.8704	0.9127	0.8910	13109	0.6631	0.6915	0.6770	15864	0.0	0.0	0.0	59	0.7465	0.7715	0.7588	15560	0.7529	0.7472	0.7500	3267	0.9141	0.9446	0.9291	11732	0.9228	0.9455	0.9340	8812	0.4926	0.5224	0.5070	16200	0.9191	0.9516	0.9351	12945	0.3432	0.4126	0.3747	2254	0.7459	0.8112	0.7772	9083	0.8651	0.9058	0.8850	15300	0.0	0.0	0.0	46	0.7366	0.7718	0.7538	15508	0.0	0.0	0.0	115	0.7190	0.7224	0.7207	15102	0.1282	0.0676	0.0885	74	0.6810	0.7416	0.7100	10405	0.1825	0.2021	0.1918	579	0.7743	0.8037	0.7887	0.9432
0.0158	15.0	136710	0.3738	0.6664	0.6893	0.6777	246054	0.8917	0.8680	0.8797	8098	0.9254	0.9499	0.9375	41279	0.9104	0.9670	0.9379	83205	0.7702	0.8362	0.8019	35943	0.0798	0.0339	0.0476	944	0.5539	0.4986	0.5248	1422	0.6415	0.6266	0.6340	4156	0.7471	0.7677	0.7572	6198	0.4939	0.5034	0.4987	2755	0.7447	0.7638	0.7541	7164	0.9178	0.9226	0.9202	15446	0.8888	0.8866	0.8877	15381	0.8894	0.8967	0.8930	16582	0.8891	0.9151	0.9019	16194	0.8229	0.8469	0.8347	15432	0.8739	0.8978	0.8857	16505	0.8484	0.8771	0.8625	16111	0.8587	0.8790	0.8687	9728	0.8345	0.8558	0.8450	16413	0.6038	0.6710	0.6356	3568	0.9193	0.9497	0.9343	16068	0.3591	0.3878	0.3729	1787	0.8659	0.9159	0.8902	13109	0.6627	0.6892	0.6757	15864	0.0	0.0	0.0	59	0.7524	0.7697	0.7610	15560	0.7609	0.7432	0.7519	3267	0.9160	0.9456	0.9305	11732	0.9238	0.9476	0.9355	8812	0.5022	0.5156	0.5088	16200	0.9191	0.9514	0.9350	12945	0.3369	0.4135	0.3713	2254	0.7421	0.8159	0.7773	9083	0.8653	0.9066	0.8855	15300	0.0	0.0	0.0	46	0.7361	0.7640	0.7498	15508	0.0	0.0	0.0	115	0.7191	0.7240	0.7215	15102	0.1064	0.0676	0.0826	74	0.6838	0.7327	0.7074	10405	0.1691	0.2159	0.1897	579	0.7746	0.8028	0.7884	0.9432
0.0145	16.0	145824	0.3850	0.6661	0.6895	0.6776	246054	0.8887	0.8671	0.8778	8098	0.9272	0.9439	0.9355	41279	0.9102	0.9664	0.9375	83205	0.7705	0.8284	0.7984	35943	0.0756	0.0328	0.0458	944	0.5415	0.4866	0.5126	1422	0.6363	0.6275	0.6319	4156	0.7324	0.7659	0.7488	6198	0.5093	0.4991	0.5041	2755	0.7453	0.7619	0.7535	7164	0.9169	0.9232	0.9200	15446	0.8890	0.8882	0.8886	15381	0.8887	0.8997	0.8941	16582	0.8900	0.9137	0.9017	16194	0.8256	0.8475	0.8364	15432	0.8742	0.8973	0.8856	16505	0.8498	0.8760	0.8627	16111	0.8579	0.8794	0.8685	9728	0.8319	0.8562	0.8439	16413	0.6078	0.6757	0.6399	3568	0.9190	0.9484	0.9334	16068	0.3472	0.3772	0.3616	1787	0.8658	0.9156	0.8900	13109	0.6676	0.6892	0.6782	15864	0.0	0.0	0.0	59	0.7466	0.7705	0.7583	15560	0.7517	0.7487	0.7502	3267	0.9160	0.9468	0.9311	11732	0.9233	0.9472	0.9351	8812	0.5007	0.5155	0.5080	16200	0.9191	0.9497	0.9342	12945	0.3449	0.4228	0.3799	2254	0.7408	0.8187	0.7778	9083	0.8675	0.9053	0.8860	15300	0.0	0.0	0.0	46	0.7352	0.7638	0.7492	15508	0.0	0.0	0.0	115	0.7202	0.7261	0.7231	15102	0.1064	0.0676	0.0826	74	0.6840	0.7237	0.7033	10405	0.1816	0.2211	0.1994	579	0.7743	0.8020	0.7879	0.9433

Framework versions

• Transformers 4.41.2
• Pytorch 2.0.1+cu117
• Datasets 2.19.1
• Tokenizers 0.19.1