bert-base-multilingual-cased-iob2-20240810154618

This model is a fine-tuned version of bert-base-multilingual-cased on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.2420
Overall Strict Precision: 0.7745
Overall Strict Recall: 0.7279
Overall Strict F1: 0.7505
Overall Ent Type Precision: 0.8569
Overall Ent Type Recall: 0.8054
Overall Ent Type F1: 0.8304
Overall Partial Precision: 0.8287
Overall Partial Recall: 0.7789
Overall Partial F1: 0.8031
Overall Exact Precision: 0.7852
Overall Exact Recall: 0.7380
Overall Exact F1: 0.7608
Documenttype Strict Precision: 0.2097
Documenttype Strict Recall: 0.7668
Documenttype Strict F1: 0.3294
Documenttype Ent Type Precision: 0.2289
Documenttype Ent Type Recall: 0.8369
Documenttype Ent Type F1: 0.3595
Documenttype Partial Precision: 0.2199
Documenttype Partial Recall: 0.8041
Documenttype Partial F1: 0.3454
Documenttype Exact Precision: 0.2101
Documenttype Exact Recall: 0.7680
Documenttype Exact F1: 0.3299
Hotelbankaccount Strict Precision: 0.0
Hotelbankaccount Strict Recall: 0.0
Hotelbankaccount Strict F1: 0
Hotelbankaccount Ent Type Precision: 0.0
Hotelbankaccount Ent Type Recall: 0.0
Hotelbankaccount Ent Type F1: 0
Hotelbankaccount Partial Precision: 0.0
Hotelbankaccount Partial Recall: 0.0
Hotelbankaccount Partial F1: 0
Hotelbankaccount Exact Precision: 0.0
Hotelbankaccount Exact Recall: 0.0
Hotelbankaccount Exact F1: 0
Hotelcity Strict Precision: 0.1849
Hotelcity Strict Recall: 0.6568
Hotelcity Strict F1: 0.2886
Hotelcity Ent Type Precision: 0.2013
Hotelcity Ent Type Recall: 0.7152
Hotelcity Ent Type F1: 0.3142
Hotelcity Partial Precision: 0.1972
Hotelcity Partial Recall: 0.7004
Hotelcity Partial F1: 0.3077
Hotelcity Exact Precision: 0.1879
Hotelcity Exact Recall: 0.6676
Hotelcity Exact F1: 0.2933
Grossamount Strict Precision: 0.1695
Grossamount Strict Recall: 0.6543
Grossamount Strict F1: 0.2692
Grossamount Ent Type Precision: 0.1865
Grossamount Ent Type Recall: 0.7199
Grossamount Ent Type F1: 0.2962
Grossamount Partial Precision: 0.1798
Grossamount Partial Recall: 0.6943
Grossamount Partial F1: 0.2857
Grossamount Exact Precision: 0.1711
Grossamount Exact Recall: 0.6606
Grossamount Exact F1: 0.2718
Companycountry Strict Precision: 0.1575
Companycountry Strict Recall: 0.8711
Companycountry Strict F1: 0.2667
Companycountry Ent Type Precision: 0.1586
Companycountry Ent Type Recall: 0.8773
Companycountry Ent Type F1: 0.2686
Companycountry Partial Precision: 0.1616
Companycountry Partial Recall: 0.8942
Companycountry Partial F1: 0.2738
Companycountry Exact Precision: 0.1608
Companycountry Exact Recall: 0.8898
Companycountry Exact F1: 0.2724
Companyaddress Strict Precision: 0.2099
Companyaddress Strict Recall: 0.7743
Companyaddress Strict F1: 0.3302
Companyaddress Ent Type Precision: 0.2471
Companyaddress Ent Type Recall: 0.9117
Companyaddress Ent Type F1: 0.3888
Companyaddress Partial Precision: 0.2311
Companyaddress Partial Recall: 0.8526
Companyaddress Partial F1: 0.3637
Companyaddress Exact Precision: 0.2113
Companyaddress Exact Recall: 0.7796
Companyaddress Exact F1: 0.3325
Reservationnumber Strict Precision: 0.0322
Reservationnumber Strict Recall: 0.5360
Reservationnumber Strict F1: 0.0608
Reservationnumber Ent Type Precision: 0.0338
Reservationnumber Ent Type Recall: 0.5622
Reservationnumber Ent Type F1: 0.0638
Reservationnumber Partial Precision: 0.0392
Reservationnumber Partial Recall: 0.6526
Reservationnumber Partial F1: 0.0740
Reservationnumber Exact Precision: 0.0376
Reservationnumber Exact Recall: 0.6258
Reservationnumber Exact F1: 0.0710
Companyname Strict Precision: 0.1952
Companyname Strict Recall: 0.7132
Companyname Strict F1: 0.3065
Companyname Ent Type Precision: 0.2413
Companyname Ent Type Recall: 0.8818
Companyname Ent Type F1: 0.3789
Companyname Partial Precision: 0.2210
Companyname Partial Recall: 0.8075
Companyname Partial F1: 0.3470
Companyname Exact Precision: 0.1968
Companyname Exact Recall: 0.7191
Companyname Exact F1: 0.3090
Companycity Strict Precision: 0.2259
Companycity Strict Recall: 0.8409
Companycity Strict F1: 0.3561
Companycity Ent Type Precision: 0.2412
Companycity Ent Type Recall: 0.8979
Companycity Ent Type F1: 0.3802
Companycity Partial Precision: 0.2388
Companycity Partial Recall: 0.8889
Companycity Partial F1: 0.3764
Companycity Exact Precision: 0.2301
Companycity Exact Recall: 0.8566
Companycity Exact F1: 0.3628
Travellername Strict Precision: 0.1816
Travellername Strict Recall: 0.5472
Travellername Strict F1: 0.2727
Travellername Ent Type Precision: 0.2468
Travellername Ent Type Recall: 0.7437
Travellername Ent Type F1: 0.3706
Travellername Partial Precision: 0.2157
Travellername Partial Recall: 0.6501
Travellername Partial F1: 0.3240
Travellername Exact Precision: 0.1826
Travellername Exact Recall: 0.5502
Travellername Exact F1: 0.2742
Cardnumber Strict Precision: 0.0082
Cardnumber Strict Recall: 0.3364
Cardnumber Strict F1: 0.0159
Cardnumber Ent Type Precision: 0.0106
Cardnumber Ent Type Recall: 0.4364
Cardnumber Ent Type F1: 0.0206
Cardnumber Partial Precision: 0.0095
Cardnumber Partial Recall: 0.3916
Cardnumber Partial F1: 0.0185
Cardnumber Exact Precision: 0.0082
Cardnumber Exact Recall: 0.3402
Cardnumber Exact F1: 0.0161
Hotelname Strict Precision: 0.1120
Hotelname Strict Recall: 0.3387
Hotelname Strict F1: 0.1684
Hotelname Ent Type Precision: 0.1762
Hotelname Ent Type Recall: 0.5326
Hotelname Ent Type F1: 0.2647
Hotelname Partial Precision: 0.1462
Hotelname Partial Recall: 0.4419
Hotelname Partial F1: 0.2197
Hotelname Exact Precision: 0.1124
Hotelname Exact Recall: 0.3397
Hotelname Exact F1: 0.1689
Invoicenumber Strict Precision: 0.2272
Invoicenumber Strict Recall: 0.8456
Invoicenumber Strict F1: 0.3582
Invoicenumber Ent Type Precision: 0.2414
Invoicenumber Ent Type Recall: 0.8982
Invoicenumber Ent Type F1: 0.3805
Invoicenumber Partial Precision: 0.2371
Invoicenumber Partial Recall: 0.8822
Invoicenumber Partial F1: 0.3737
Invoicenumber Exact Precision: 0.2297
Invoicenumber Exact Recall: 0.8550
Invoicenumber Exact F1: 0.3622
Externalreservationnumber Strict Precision: 0.0072
Externalreservationnumber Strict Recall: 0.3792
Externalreservationnumber Strict F1: 0.0140
Externalreservationnumber Ent Type Precision: 0.0083
Externalreservationnumber Ent Type Recall: 0.4402
Externalreservationnumber Ent Type F1: 0.0163
Externalreservationnumber Partial Precision: 0.0131
Externalreservationnumber Partial Recall: 0.6962
Externalreservationnumber Partial F1: 0.0258
Externalreservationnumber Exact Precision: 0.0122
Externalreservationnumber Exact Recall: 0.6459
Externalreservationnumber Exact F1: 0.0239
Pagenumber Strict Precision: 0.1361
Pagenumber Strict Recall: 0.8345
Pagenumber Strict F1: 0.2340
Pagenumber Ent Type Precision: 0.1371
Pagenumber Ent Type Recall: 0.8404
Pagenumber Ent Type F1: 0.2357
Pagenumber Partial Precision: 0.1367
Pagenumber Partial Recall: 0.8384
Pagenumber Partial F1: 0.2351
Pagenumber Exact Precision: 0.1363
Pagenumber Exact Recall: 0.8355
Pagenumber Exact F1: 0.2343
Companyzipcode Strict Precision: 0.2412
Companyzipcode Strict Recall: 0.9120
Companyzipcode Strict F1: 0.3815
Companyzipcode Ent Type Precision: 0.2478
Companyzipcode Ent Type Recall: 0.9369
Companyzipcode Ent Type F1: 0.3919
Companyzipcode Partial Precision: 0.2472
Companyzipcode Partial Recall: 0.9349
Companyzipcode Partial F1: 0.3911
Companyzipcode Exact Precision: 0.2431
Companyzipcode Exact Recall: 0.9192
Companyzipcode Exact F1: 0.3845
Companyvatnumber Strict Precision: 0.0585
Companyvatnumber Strict Recall: 0.6388
Companyvatnumber Strict F1: 0.1072
Companyvatnumber Ent Type Precision: 0.0629
Companyvatnumber Ent Type Recall: 0.6869
Companyvatnumber Ent Type F1: 0.1152
Companyvatnumber Partial Precision: 0.0674
Companyvatnumber Partial Recall: 0.7361
Companyvatnumber Partial F1: 0.1235
Companyvatnumber Exact Precision: 0.0648
Companyvatnumber Exact Recall: 0.7076
Companyvatnumber Exact F1: 0.1187
Netamount Strict Precision: 0.0996
Netamount Strict Recall: 0.7072
Netamount Strict F1: 0.1746
Netamount Ent Type Precision: 0.1127
Netamount Ent Type Recall: 0.8005
Netamount Ent Type F1: 0.1976
Netamount Partial Precision: 0.1086
Netamount Partial Recall: 0.7708
Netamount Partial F1: 0.1903
Netamount Exact Precision: 0.1017
Netamount Exact Recall: 0.7220
Netamount Exact F1: 0.1783
Bookingnumber Strict Precision: 0.0290
Bookingnumber Strict Recall: 0.5071
Bookingnumber Strict F1: 0.0548
Bookingnumber Ent Type Precision: 0.0327
Bookingnumber Ent Type Recall: 0.5723
Bookingnumber Ent Type F1: 0.0619
Bookingnumber Partial Precision: 0.0357
Bookingnumber Partial Recall: 0.6249
Bookingnumber Partial F1: 0.0676
Bookingnumber Exact Precision: 0.0335
Bookingnumber Exact Recall: 0.5861
Bookingnumber Exact F1: 0.0634
Hotelcountry Strict Precision: 0.0559
Hotelcountry Strict Recall: 0.7665
Hotelcountry Strict F1: 0.1042
Hotelcountry Ent Type Precision: 0.0566
Hotelcountry Ent Type Recall: 0.7768
Hotelcountry Ent Type F1: 0.1056
Hotelcountry Partial Precision: 0.0580
Hotelcountry Partial Recall: 0.7949
Hotelcountry Partial F1: 0.1080
Hotelcountry Exact Precision: 0.0575
Hotelcountry Exact Recall: 0.7886
Hotelcountry Exact F1: 0.1072
Hotelphonenumber Strict Precision: 0.1727
Hotelphonenumber Strict Recall: 0.7689
Hotelphonenumber Strict F1: 0.2820
Hotelphonenumber Ent Type Precision: 0.2053
Hotelphonenumber Ent Type Recall: 0.9142
Hotelphonenumber Ent Type F1: 0.3353
Hotelphonenumber Partial Precision: 0.1894
Hotelphonenumber Partial Recall: 0.8433
Hotelphonenumber Partial F1: 0.3093
Hotelphonenumber Exact Precision: 0.1730
Hotelphonenumber Exact Recall: 0.7704
Hotelphonenumber Exact F1: 0.2826
Hotelzipcode Strict Precision: 0.1949
Hotelzipcode Strict Recall: 0.7128
Hotelzipcode Strict F1: 0.3061
Hotelzipcode Ent Type Precision: 0.2060
Hotelzipcode Ent Type Recall: 0.7534
Hotelzipcode Ent Type F1: 0.3235
Hotelzipcode Partial Precision: 0.2024
Hotelzipcode Partial Recall: 0.7404
Hotelzipcode Partial F1: 0.3180
Hotelzipcode Exact Precision: 0.1964
Hotelzipcode Exact Recall: 0.7183
Hotelzipcode Exact F1: 0.3085
Invoicedate Strict Precision: 0.2393
Invoicedate Strict Recall: 0.9082
Invoicedate Strict F1: 0.3788
Invoicedate Ent Type Precision: 0.2450
Invoicedate Ent Type Recall: 0.9296
Invoicedate Ent Type F1: 0.3878
Invoicedate Partial Precision: 0.2441
Invoicedate Partial Recall: 0.9262
Invoicedate Partial F1: 0.3863
Invoicedate Exact Precision: 0.2412
Invoicedate Exact Recall: 0.9154
Invoicedate Exact F1: 0.3818
Hotelfaxnumber Strict Precision: 0.1269
Hotelfaxnumber Strict Recall: 0.7926
Hotelfaxnumber Strict F1: 0.2187
Hotelfaxnumber Ent Type Precision: 0.1438
Hotelfaxnumber Ent Type Recall: 0.8982
Hotelfaxnumber Ent Type F1: 0.2478
Hotelfaxnumber Partial Precision: 0.1355
Hotelfaxnumber Partial Recall: 0.8464
Hotelfaxnumber Partial F1: 0.2336
Hotelfaxnumber Exact Precision: 0.1270
Hotelfaxnumber Exact Recall: 0.7932
Hotelfaxnumber Exact F1: 0.2189
Taxamount Strict Precision: 0.0875
Taxamount Strict Recall: 0.7603
Taxamount Strict F1: 0.1570
Taxamount Ent Type Precision: 0.0977
Taxamount Ent Type Recall: 0.8485
Taxamount Ent Type F1: 0.1752
Taxamount Partial Precision: 0.0930
Taxamount Partial Recall: 0.8081
Taxamount Partial F1: 0.1668
Taxamount Exact Precision: 0.0878
Taxamount Exact Recall: 0.7626
Taxamount Exact F1: 0.1574
Hotelvatnumber Strict Precision: 0.1339
Hotelvatnumber Strict Recall: 0.6758
Hotelvatnumber Strict F1: 0.2235
Hotelvatnumber Ent Type Precision: 0.1429
Hotelvatnumber Ent Type Recall: 0.7212
Hotelvatnumber Ent Type F1: 0.2385
Hotelvatnumber Partial Precision: 0.1479
Hotelvatnumber Partial Recall: 0.7465
Hotelvatnumber Partial F1: 0.2469
Hotelvatnumber Exact Precision: 0.1428
Hotelvatnumber Exact Recall: 0.7206
Hotelvatnumber Exact F1: 0.2383
Roomno Strict Precision: 0.2560
Roomno Strict Recall: 0.8330
Roomno Strict F1: 0.3917
Roomno Ent Type Precision: 0.2591
Roomno Ent Type Recall: 0.8430
Roomno Ent Type F1: 0.3964
Roomno Partial Precision: 0.2601
Roomno Partial Recall: 0.8463
Roomno Partial F1: 0.3979
Roomno Exact Precision: 0.2583
Roomno Exact Recall: 0.8406
Roomno Exact F1: 0.3952
Hotelemail Strict Precision: 0.1803
Hotelemail Strict Recall: 0.8767
Hotelemail Strict F1: 0.2991
Hotelemail Ent Type Precision: 0.1890
Hotelemail Ent Type Recall: 0.9193
Hotelemail Ent Type F1: 0.3136
Hotelemail Partial Precision: 0.1847
Hotelemail Partial Recall: 0.8983
Hotelemail Partial F1: 0.3064
Hotelemail Exact Precision: 0.1803
Hotelemail Exact Recall: 0.8770
Hotelemail Exact F1: 0.2991
Hoteltaxcode Strict Precision: 0.0357
Hoteltaxcode Strict Recall: 0.4683
Hoteltaxcode Strict F1: 0.0664
Hoteltaxcode Ent Type Precision: 0.0379
Hoteltaxcode Ent Type Recall: 0.4970
Hoteltaxcode Ent Type F1: 0.0704
Hoteltaxcode Partial Precision: 0.0416
Hoteltaxcode Partial Recall: 0.5455
Hoteltaxcode Partial F1: 0.0773
Hoteltaxcode Exact Precision: 0.0399
Hoteltaxcode Exact Recall: 0.5234
Hoteltaxcode Exact F1: 0.0742
Checkin Strict Precision: 0.2628
Checkin Strict Recall: 0.9065
Checkin Strict F1: 0.4075
Checkin Ent Type Precision: 0.2678
Checkin Ent Type Recall: 0.9237
Checkin Ent Type F1: 0.4152
Checkin Partial Precision: 0.2676
Checkin Partial Recall: 0.9230
Checkin Partial F1: 0.4149
Checkin Exact Precision: 0.2646
Checkin Exact Recall: 0.9128
Checkin Exact F1: 0.4103
Hoteladdress Strict Precision: 0.1384
Hoteladdress Strict Recall: 0.4768
Hoteladdress Strict F1: 0.2145
Hoteladdress Ent Type Precision: 0.2033
Hoteladdress Ent Type Recall: 0.7004
Hoteladdress Ent Type F1: 0.3151
Hoteladdress Partial Precision: 0.1733
Hoteladdress Partial Recall: 0.5972
Hoteladdress Partial F1: 0.2687
Hoteladdress Exact Precision: 0.1396
Hoteladdress Exact Recall: 0.4811
Hoteladdress Exact F1: 0.2164
Currencycode Strict Precision: 0.1020
Currencycode Strict Recall: 0.4973
Currencycode Strict F1: 0.1693
Currencycode Ent Type Precision: 0.1027
Currencycode Ent Type Recall: 0.5006
Currencycode Ent Type F1: 0.1705
Currencycode Partial Precision: 0.1024
Currencycode Partial Recall: 0.4992
Currencycode Partial F1: 0.1700
Currencycode Exact Precision: 0.1021
Currencycode Exact Recall: 0.4976
Currencycode Exact F1: 0.1694
Cardtype Strict Precision: 0.0497
Cardtype Strict Recall: 0.5110
Cardtype Strict F1: 0.0905
Cardtype Ent Type Precision: 0.0562
Cardtype Ent Type Recall: 0.5784
Cardtype Ent Type F1: 0.1025
Cardtype Partial Precision: 0.0530
Cardtype Partial Recall: 0.5451
Cardtype Partial F1: 0.0966
Cardtype Exact Precision: 0.0497
Cardtype Exact Recall: 0.5114
Cardtype Exact F1: 0.0906
Checkout Strict Precision: 0.2629
Checkout Strict Recall: 0.9177
Checkout Strict F1: 0.4087
Checkout Ent Type Precision: 0.2671
Checkout Ent Type Recall: 0.9322
Checkout Ent Type F1: 0.4152
Checkout Partial Precision: 0.2665
Checkout Partial Recall: 0.9304
Checkout Partial F1: 0.4144
Checkout Exact Precision: 0.2643
Checkout Exact Recall: 0.9227
Checkout Exact F1: 0.4109

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
gradient_accumulation_steps: 16
total_train_batch_size: 128
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
lr_scheduler_warmup_ratio: 0.0625
num_epochs: 8

Training results

Training Loss	Epoch	Step	Validation Loss	Overall Strict Precision	Overall Strict Recall	Overall Strict F1	Overall Ent Type Precision	Overall Ent Type Recall	Overall Ent Type F1	Overall Partial Precision	Overall Partial Recall	Overall Partial F1	Overall Exact Precision	Overall Exact Recall	Overall Exact F1	Documenttype Strict Precision	Documenttype Strict Recall	Documenttype Strict F1	Documenttype Ent Type Precision	Documenttype Ent Type Recall	Documenttype Ent Type F1	Documenttype Partial Precision	Documenttype Partial Recall	Documenttype Partial F1	Documenttype Exact Precision	Documenttype Exact Recall	Documenttype Exact F1	Hotelbankaccount Strict Recall	Hotelbankaccount Ent Type Recall	Hotelbankaccount Partial Recall	Hotelbankaccount Exact Recall	Hotelcity Strict Precision	Hotelcity Strict Recall	Hotelcity Strict F1	Hotelcity Ent Type Precision	Hotelcity Ent Type Recall	Hotelcity Ent Type F1	Hotelcity Partial Precision	Hotelcity Partial Recall	Hotelcity Partial F1	Hotelcity Exact Precision	Hotelcity Exact Recall	Hotelcity Exact F1	Grossamount Strict Precision	Grossamount Strict Recall	Grossamount Strict F1	Grossamount Ent Type Precision	Grossamount Ent Type Recall	Grossamount Ent Type F1	Grossamount Partial Precision	Grossamount Partial Recall	Grossamount Partial F1	Grossamount Exact Precision	Grossamount Exact Recall	Grossamount Exact F1	Companycountry Strict Precision	Companycountry Strict Recall	Companycountry Strict F1	Companycountry Ent Type Precision	Companycountry Ent Type Recall	Companycountry Ent Type F1	Companycountry Partial Precision	Companycountry Partial Recall	Companycountry Partial F1	Companycountry Exact Precision	Companycountry Exact Recall	Companycountry Exact F1	Companyaddress Strict Precision	Companyaddress Strict Recall	Companyaddress Strict F1	Companyaddress Ent Type Precision	Companyaddress Ent Type Recall	Companyaddress Ent Type F1	Companyaddress Partial Precision	Companyaddress Partial Recall	Companyaddress Partial F1	Companyaddress Exact Precision	Companyaddress Exact Recall	Companyaddress Exact F1	Reservationnumber Strict Precision	Reservationnumber Strict Recall	Reservationnumber Strict F1	Reservationnumber Ent Type Precision	Reservationnumber Ent Type Recall	Reservationnumber Ent Type F1	Reservationnumber Partial Precision	Reservationnumber Partial Recall	Reservationnumber Partial F1	Reservationnumber Exact Precision	Reservationnumber Exact Recall	Reservationnumber Exact F1	Companyname Strict Precision	Companyname Strict Recall	Companyname Strict F1	Companyname Ent Type Precision	Companyname Ent Type Recall	Companyname Ent Type F1	Companyname Partial Precision	Companyname Partial Recall	Companyname Partial F1	Companyname Exact Precision	Companyname Exact Recall	Companyname Exact F1	Companycity Strict Precision	Companycity Strict Recall	Companycity Strict F1	Companycity Ent Type Precision	Companycity Ent Type Recall	Companycity Ent Type F1	Companycity Partial Precision	Companycity Partial Recall	Companycity Partial F1	Companycity Exact Precision	Companycity Exact Recall	Companycity Exact F1	Travellername Strict Precision	Travellername Strict Recall	Travellername Strict F1	Travellername Ent Type Precision	Travellername Ent Type Recall	Travellername Ent Type F1	Travellername Partial Precision	Travellername Partial Recall	Travellername Partial F1	Travellername Exact Precision	Travellername Exact Recall	Travellername Exact F1	Cardnumber Strict Precision	Cardnumber Strict Recall	Cardnumber Strict F1	Cardnumber Ent Type Precision	Cardnumber Ent Type Recall	Cardnumber Ent Type F1	Cardnumber Partial Precision	Cardnumber Partial Recall	Cardnumber Partial F1	Cardnumber Exact Precision	Cardnumber Exact Recall	Cardnumber Exact F1	Hotelname Strict Precision	Hotelname Strict Recall	Hotelname Strict F1	Hotelname Ent Type Precision	Hotelname Ent Type Recall	Hotelname Ent Type F1	Hotelname Partial Precision	Hotelname Partial Recall	Hotelname Partial F1	Hotelname Exact Precision	Hotelname Exact Recall	Hotelname Exact F1	Invoicenumber Strict Precision	Invoicenumber Strict Recall	Invoicenumber Strict F1	Invoicenumber Ent Type Precision	Invoicenumber Ent Type Recall	Invoicenumber Ent Type F1	Invoicenumber Partial Precision	Invoicenumber Partial Recall	Invoicenumber Partial F1	Invoicenumber Exact Precision	Invoicenumber Exact Recall	Invoicenumber Exact F1	Externalreservationnumber Strict Precision	Externalreservationnumber Strict Recall	Externalreservationnumber Strict F1	Externalreservationnumber Ent Type Precision	Externalreservationnumber Ent Type Recall	Externalreservationnumber Ent Type F1	Externalreservationnumber Partial Precision	Externalreservationnumber Partial Recall	Externalreservationnumber Partial F1	Externalreservationnumber Exact Precision	Externalreservationnumber Exact Recall	Externalreservationnumber Exact F1	Pagenumber Strict Precision	Pagenumber Strict Recall	Pagenumber Strict F1	Pagenumber Ent Type Precision	Pagenumber Ent Type Recall	Pagenumber Ent Type F1	Pagenumber Partial Precision	Pagenumber Partial Recall	Pagenumber Partial F1	Pagenumber Exact Precision	Pagenumber Exact Recall	Pagenumber Exact F1	Companyzipcode Strict Precision	Companyzipcode Strict Recall	Companyzipcode Strict F1	Companyzipcode Ent Type Precision	Companyzipcode Ent Type Recall	Companyzipcode Ent Type F1	Companyzipcode Partial Precision	Companyzipcode Partial Recall	Companyzipcode Partial F1	Companyzipcode Exact Precision	Companyzipcode Exact Recall	Companyzipcode Exact F1	Companyvatnumber Strict Precision	Companyvatnumber Strict Recall	Companyvatnumber Strict F1	Companyvatnumber Ent Type Precision	Companyvatnumber Ent Type Recall	Companyvatnumber Ent Type F1	Companyvatnumber Partial Precision	Companyvatnumber Partial Recall	Companyvatnumber Partial F1	Companyvatnumber Exact Precision	Companyvatnumber Exact Recall	Companyvatnumber Exact F1	Netamount Strict Precision	Netamount Strict Recall	Netamount Strict F1	Netamount Ent Type Precision	Netamount Ent Type Recall	Netamount Ent Type F1	Netamount Partial Precision	Netamount Partial Recall	Netamount Partial F1	Netamount Exact Precision	Netamount Exact Recall	Netamount Exact F1	Bookingnumber Strict Precision	Bookingnumber Strict Recall	Bookingnumber Strict F1	Bookingnumber Ent Type Precision	Bookingnumber Ent Type Recall	Bookingnumber Ent Type F1	Bookingnumber Partial Precision	Bookingnumber Partial Recall	Bookingnumber Partial F1	Bookingnumber Exact Precision	Bookingnumber Exact Recall	Bookingnumber Exact F1	Hotelcountry Strict Precision	Hotelcountry Strict Recall	Hotelcountry Strict F1	Hotelcountry Ent Type Precision	Hotelcountry Ent Type Recall	Hotelcountry Ent Type F1	Hotelcountry Partial Precision	Hotelcountry Partial Recall	Hotelcountry Partial F1	Hotelcountry Exact Precision	Hotelcountry Exact Recall	Hotelcountry Exact F1	Hotelphonenumber Strict Precision	Hotelphonenumber Strict Recall	Hotelphonenumber Strict F1	Hotelphonenumber Ent Type Precision	Hotelphonenumber Ent Type Recall	Hotelphonenumber Ent Type F1	Hotelphonenumber Partial Precision	Hotelphonenumber Partial Recall	Hotelphonenumber Partial F1	Hotelphonenumber Exact Precision	Hotelphonenumber Exact Recall	Hotelphonenumber Exact F1	Hotelzipcode Strict Precision	Hotelzipcode Strict Recall	Hotelzipcode Strict F1	Hotelzipcode Ent Type Precision	Hotelzipcode Ent Type Recall	Hotelzipcode Ent Type F1	Hotelzipcode Partial Precision	Hotelzipcode Partial Recall	Hotelzipcode Partial F1	Hotelzipcode Exact Precision	Hotelzipcode Exact Recall	Hotelzipcode Exact F1	Invoicedate Strict Precision	Invoicedate Strict Recall	Invoicedate Strict F1	Invoicedate Ent Type Precision	Invoicedate Ent Type Recall	Invoicedate Ent Type F1	Invoicedate Partial Precision	Invoicedate Partial Recall	Invoicedate Partial F1	Invoicedate Exact Precision	Invoicedate Exact Recall	Invoicedate Exact F1	Hotelfaxnumber Strict Precision	Hotelfaxnumber Strict Recall	Hotelfaxnumber Strict F1	Hotelfaxnumber Ent Type Precision	Hotelfaxnumber Ent Type Recall	Hotelfaxnumber Ent Type F1	Hotelfaxnumber Partial Precision	Hotelfaxnumber Partial Recall	Hotelfaxnumber Partial F1	Hotelfaxnumber Exact Precision	Hotelfaxnumber Exact Recall	Hotelfaxnumber Exact F1	Taxamount Strict Precision	Taxamount Strict Recall	Taxamount Strict F1	Taxamount Ent Type Precision	Taxamount Ent Type Recall	Taxamount Ent Type F1	Taxamount Partial Precision	Taxamount Partial Recall	Taxamount Partial F1	Taxamount Exact Precision	Taxamount Exact Recall	Taxamount Exact F1	Hotelvatnumber Strict Precision	Hotelvatnumber Strict Recall	Hotelvatnumber Strict F1	Hotelvatnumber Ent Type Precision	Hotelvatnumber Ent Type Recall	Hotelvatnumber Ent Type F1	Hotelvatnumber Partial Precision	Hotelvatnumber Partial Recall	Hotelvatnumber Partial F1	Hotelvatnumber Exact Precision	Hotelvatnumber Exact Recall	Hotelvatnumber Exact F1	Roomno Strict Precision	Roomno Strict Recall	Roomno Strict F1	Roomno Ent Type Precision	Roomno Ent Type Recall	Roomno Ent Type F1	Roomno Partial Precision	Roomno Partial Recall	Roomno Partial F1	Roomno Exact Precision	Roomno Exact Recall	Roomno Exact F1	Hotelemail Strict Precision	Hotelemail Strict Recall	Hotelemail Strict F1	Hotelemail Ent Type Precision	Hotelemail Ent Type Recall	Hotelemail Ent Type F1	Hotelemail Partial Precision	Hotelemail Partial Recall	Hotelemail Partial F1	Hotelemail Exact Precision	Hotelemail Exact Recall	Hotelemail Exact F1	Hoteltaxcode Strict Precision	Hoteltaxcode Strict Recall	Hoteltaxcode Strict F1	Hoteltaxcode Ent Type Precision	Hoteltaxcode Ent Type Recall	Hoteltaxcode Ent Type F1	Hoteltaxcode Partial Precision	Hoteltaxcode Partial Recall	Hoteltaxcode Partial F1	Hoteltaxcode Exact Precision	Hoteltaxcode Exact Recall	Hoteltaxcode Exact F1	Checkin Strict Precision	Checkin Strict Recall	Checkin Strict F1	Checkin Ent Type Precision	Checkin Ent Type Recall	Checkin Ent Type F1	Checkin Partial Precision	Checkin Partial Recall	Checkin Partial F1	Checkin Exact Precision	Checkin Exact Recall	Checkin Exact F1	Hoteladdress Strict Precision	Hoteladdress Strict Recall	Hoteladdress Strict F1	Hoteladdress Ent Type Precision	Hoteladdress Ent Type Recall	Hoteladdress Ent Type F1	Hoteladdress Partial Precision	Hoteladdress Partial Recall	Hoteladdress Partial F1	Hoteladdress Exact Precision	Hoteladdress Exact Recall	Hoteladdress Exact F1	Currencycode Strict Precision	Currencycode Strict Recall	Currencycode Strict F1	Currencycode Ent Type Precision	Currencycode Ent Type Recall	Currencycode Ent Type F1	Currencycode Partial Precision	Currencycode Partial Recall	Currencycode Partial F1	Currencycode Exact Precision	Currencycode Exact Recall	Currencycode Exact F1	Cardtype Strict Precision	Cardtype Strict Recall	Cardtype Strict F1	Cardtype Ent Type Precision	Cardtype Ent Type Recall	Cardtype Ent Type F1	Cardtype Partial Precision	Cardtype Partial Recall	Cardtype Partial F1	Cardtype Exact Precision	Cardtype Exact Recall	Cardtype Exact F1	Checkout Strict Precision	Checkout Strict Recall	Checkout Strict F1	Checkout Ent Type Precision	Checkout Ent Type Recall	Checkout Ent Type F1	Checkout Partial Precision	Checkout Partial Recall	Checkout Partial F1	Checkout Exact Precision	Checkout Exact Recall	Checkout Exact F1
0.7246	0.9998	576	0.2102	0.7318	0.6818	0.7059	0.8287	0.7720	0.7993	0.7990	0.7443	0.7707	0.7463	0.6952	0.7199	0.1859	0.7187	0.2953	0.2061	0.7970	0.3275	0.1966	0.7602	0.3124	0.1861	0.7196	0.2957	0	0	0	0	0.1496	0.6205	0.2411	0.1661	0.6889	0.2677	0.1619	0.6716	0.2609	0.1525	0.6323	0.2457	0.1318	0.5134	0.2098	0.1519	0.5914	0.2417	0.1509	0.5876	0.2401	0.1394	0.5427	0.2218	0.1358	0.7804	0.2313	0.1376	0.7907	0.2344	0.1462	0.8400	0.2490	0.1437	0.8261	0.2449	0.1839	0.7281	0.2936	0.2199	0.8705	0.3510	0.2067	0.8184	0.3301	0.1868	0.7394	0.2982	0.0265	0.4993	0.0503	0.0300	0.5653	0.0570	0.0357	0.6717	0.0677	0.0329	0.6191	0.0624	0.1676	0.6582	0.2672	0.2134	0.8383	0.3402	0.1932	0.7589	0.3080	0.1689	0.6635	0.2693	0.2009	0.7990	0.3210	0.2127	0.8461	0.3400	0.2147	0.8542	0.3432	0.2076	0.8259	0.3318	0.1564	0.4697	0.2347	0.2244	0.6736	0.3366	0.1925	0.5780	0.2889	0.1575	0.4728	0.2363	0.0017	0.1071	0.0034	0.0087	0.5438	0.0172	0.0053	0.3279	0.0104	0.0017	0.1083	0.0034	0.0747	0.2865	0.1185	0.1367	0.5243	0.2168	0.1071	0.4108	0.1699	0.0748	0.2871	0.1187	0.1983	0.8072	0.3184	0.2160	0.8792	0.3468	0.2095	0.8527	0.3363	0.2004	0.8159	0.3218	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.1170	0.8255	0.2049	0.1180	0.8330	0.2068	0.1177	0.8309	0.2063	0.1172	0.8270	0.2053	0.2130	0.8697	0.3421	0.2199	0.8983	0.3534	0.2226	0.9091	0.3576	0.2178	0.8895	0.3499	0.0462	0.6299	0.0862	0.0522	0.7108	0.0972	0.0540	0.7361	0.1007	0.0504	0.6863	0.0939	0.0621	0.4732	0.1097	0.0787	0.5996	0.1391	0.0818	0.6232	0.1445	0.0711	0.5417	0.1256	0.0213	0.4021	0.0404	0.0296	0.5585	0.0562	0.0298	0.5626	0.0566	0.0242	0.4573	0.0460	0.0369	0.6593	0.0699	0.0383	0.6840	0.0725	0.0383	0.6837	0.0725	0.0375	0.6702	0.0711	0.1514	0.7605	0.2525	0.1806	0.9068	0.3012	0.1663	0.8351	0.2773	0.1516	0.7616	0.2529	0.1513	0.6792	0.2474	0.1638	0.7354	0.2679	0.1590	0.7138	0.2600	0.1522	0.6836	0.2490	0.2125	0.8857	0.3428	0.2196	0.9151	0.3542	0.2177	0.9074	0.3512	0.2140	0.8918	0.3452	0.1104	0.7862	0.1936	0.1257	0.8950	0.2204	0.1184	0.8427	0.2076	0.1106	0.7878	0.1940	0.0590	0.5162	0.1059	0.0736	0.6443	0.1322	0.0713	0.6239	0.1280	0.0617	0.5397	0.1107	0.1181	0.6299	0.1990	0.1303	0.6950	0.2195	0.1329	0.7088	0.2239	0.1261	0.6724	0.2124	0.2213	0.7904	0.3458	0.2246	0.8020	0.3509	0.2256	0.8057	0.3525	0.2240	0.7999	0.3500	0.1572	0.8492	0.2654	0.1656	0.8941	0.2794	0.1615	0.8720	0.2725	0.1573	0.8495	0.2655	0.0309	0.5474	0.0586	0.0353	0.6249	0.0668	0.0358	0.6334	0.0678	0.0336	0.5937	0.0635	0.2370	0.8889	0.3743	0.2426	0.9097	0.3831	0.2418	0.9068	0.3818	0.2387	0.8951	0.3769	0.0991	0.4146	0.1600	0.1627	0.6808	0.2627	0.1324	0.5541	0.2138	0.0996	0.4168	0.1608	0.0715	0.4535	0.1235	0.0721	0.4572	0.1245	0.0718	0.4557	0.1241	0.0715	0.4538	0.1236	0.0358	0.4986	0.0668	0.0409	0.5701	0.0764	0.0384	0.5345	0.0716	0.0358	0.4986	0.0668	0.2352	0.8884	0.3720	0.2406	0.9089	0.3805	0.2390	0.9025	0.3779	0.2361	0.8917	0.3734
0.1702	1.9996	1152	0.2122	0.7633	0.7157	0.7387	0.8488	0.7958	0.8215	0.8206	0.7694	0.7941	0.7749	0.7266	0.7500	0.2017	0.7482	0.3177	0.2210	0.8199	0.3482	0.2120	0.7863	0.3339	0.2020	0.7493	0.3182	0	0	0	0	0.1786	0.6357	0.2789	0.1945	0.6923	0.3037	0.1912	0.6804	0.2985	0.1822	0.6485	0.2845	0.1581	0.6073	0.2509	0.1759	0.6757	0.2791	0.1710	0.6571	0.2714	0.1617	0.6212	0.2566	0.1505	0.8524	0.2558	0.1518	0.8598	0.2581	0.1551	0.8783	0.2636	0.1542	0.8731	0.2620	0.2010	0.7606	0.3180	0.2383	0.9019	0.3770	0.2222	0.8407	0.3515	0.2025	0.7661	0.3203	0.0340	0.5212	0.0638	0.0364	0.5589	0.0684	0.0457	0.7011	0.0858	0.0433	0.6648	0.0813	0.1846	0.6878	0.2910	0.2327	0.8670	0.3669	0.2114	0.7877	0.3333	0.1860	0.6933	0.2934	0.2206	0.8467	0.3500	0.2311	0.8873	0.3668	0.2304	0.8845	0.3656	0.2245	0.8617	0.3562	0.1630	0.5467	0.2512	0.2230	0.7479	0.3436	0.1942	0.6514	0.2993	0.1638	0.5493	0.2524	0.0077	0.3903	0.0150	0.0102	0.5226	0.0201	0.0090	0.4603	0.0177	0.0077	0.3936	0.0151	0.1026	0.3244	0.1558	0.1648	0.5215	0.2505	0.1356	0.4289	0.2060	0.1029	0.3256	0.1564	0.2137	0.8222	0.3392	0.2313	0.8899	0.3671	0.2251	0.8664	0.3574	0.2161	0.8318	0.3431	0.0	0.0	0	0.0004	0.2836	0.0008	0.0004	0.2985	0.0009	0.0	0.0	0	0.1303	0.8333	0.2253	0.1313	0.8398	0.2271	0.1309	0.8375	0.2265	0.1304	0.8343	0.2256	0.2320	0.9048	0.3693	0.2389	0.9317	0.3802	0.2381	0.9286	0.3790	0.2336	0.9111	0.3718	0.0569	0.6447	0.1046	0.0627	0.7108	0.1153	0.0660	0.7476	0.1213	0.0621	0.7039	0.1142	0.0891	0.5976	0.1550	0.1032	0.6926	0.1797	0.1035	0.6944	0.1802	0.0953	0.6396	0.1660	0.0271	0.5290	0.0515	0.0319	0.6244	0.0608	0.0331	0.6466	0.0629	0.0299	0.5849	0.0569	0.0531	0.7381	0.0991	0.0543	0.7539	0.1013	0.0558	0.7745	0.1040	0.0551	0.7653	0.1028	0.1674	0.7651	0.2748	0.1979	0.9044	0.3248	0.1832	0.8371	0.3006	0.1678	0.7669	0.2754	0.1894	0.6841	0.2967	0.2012	0.7265	0.3151	0.1976	0.7134	0.3094	0.1912	0.6905	0.2995	0.2302	0.9007	0.3667	0.2366	0.9258	0.3769	0.2355	0.9215	0.3751	0.2321	0.9084	0.3698	0.1216	0.7953	0.2110	0.1377	0.9005	0.2389	0.1298	0.8487	0.2251	0.1217	0.7960	0.2111	0.0798	0.6918	0.1431	0.0911	0.7897	0.1634	0.0876	0.7598	0.1572	0.0812	0.7042	0.1457	0.1356	0.6494	0.2244	0.1460	0.6992	0.2416	0.1503	0.7193	0.2486	0.1446	0.6923	0.2392	0.2344	0.8482	0.3673	0.2367	0.8565	0.3709	0.2375	0.8592	0.3721	0.2362	0.8547	0.3701	0.1736	0.8621	0.2890	0.1820	0.9037	0.3029	0.1779	0.8833	0.2961	0.1737	0.8625	0.2891	0.0425	0.5163	0.0785	0.0468	0.5684	0.0865	0.0493	0.5987	0.0911	0.0466	0.5664	0.0862	0.2544	0.9023	0.3969	0.2600	0.9223	0.4057	0.2594	0.9200	0.4047	0.2561	0.9084	0.3996	0.1318	0.4555	0.2044	0.1971	0.6811	0.3057	0.1678	0.5800	0.2603	0.1331	0.4600	0.2064	0.0845	0.5109	0.1451	0.0850	0.5136	0.1458	0.0848	0.5125	0.1455	0.0846	0.5112	0.1451	0.0447	0.5270	0.0824	0.0500	0.5889	0.0921	0.0474	0.5584	0.0873	0.0447	0.5275	0.0825	0.2534	0.9018	0.3957	0.2587	0.9207	0.4040	0.2573	0.9154	0.4016	0.2545	0.9055	0.3973
0.1355	2.9993	1728	0.2135	0.7766	0.7130	0.7435	0.8614	0.7908	0.8246	0.8336	0.7654	0.7980	0.7883	0.7237	0.7546	0.2189	0.7623	0.3401	0.2392	0.8332	0.3717	0.2297	0.8000	0.3569	0.2192	0.7634	0.3406	0	0	0	0	0.1935	0.6467	0.2979	0.2111	0.7053	0.3249	0.2064	0.6898	0.3178	0.1966	0.6568	0.3026	0.1764	0.6265	0.2752	0.1946	0.6912	0.3036	0.1879	0.6675	0.2933	0.1785	0.6341	0.2786	0.1648	0.8603	0.2765	0.1657	0.8655	0.2782	0.1703	0.8894	0.2859	0.1696	0.8856	0.2847	0.2172	0.7607	0.3379	0.2566	0.8986	0.3992	0.2400	0.8406	0.3734	0.2191	0.7671	0.3408	0.0386	0.4357	0.0709	0.0411	0.4643	0.0756	0.0517	0.5834	0.0949	0.0483	0.5455	0.0888	0.2023	0.6986	0.3137	0.2513	0.8680	0.3898	0.2296	0.7929	0.3561	0.2037	0.7036	0.3160	0.2362	0.8321	0.3679	0.2507	0.8832	0.3905	0.2492	0.8780	0.3882	0.2410	0.8491	0.3755	0.1868	0.5112	0.2737	0.2578	0.7053	0.3775	0.2239	0.6127	0.3280	0.1878	0.5139	0.2751	0.0094	0.3308	0.0184	0.0128	0.4486	0.0249	0.0112	0.3939	0.0219	0.0095	0.3342	0.0185	0.1159	0.3344	0.1721	0.1817	0.5243	0.2699	0.1506	0.4346	0.2237	0.1161	0.3350	0.1724	0.2367	0.8346	0.3687	0.2532	0.8931	0.3946	0.2481	0.8750	0.3866	0.2397	0.8451	0.3734	0.0010	0.0698	0.0019	0.0055	0.3935	0.0109	0.0061	0.4353	0.0120	0.0019	0.1363	0.0038	0.1424	0.8225	0.2428	0.1435	0.8290	0.2447	0.1431	0.8268	0.2440	0.1426	0.8236	0.2431	0.2504	0.9044	0.3922	0.2576	0.9305	0.4035	0.2579	0.9315	0.4039	0.2531	0.9141	0.3964	0.1025	0.6558	0.1773	0.1161	0.7428	0.2009	0.1144	0.7318	0.1979	0.1068	0.6830	0.1847	0.0628	0.6178	0.1140	0.0676	0.6653	0.1228	0.0751	0.7385	0.1363	0.0717	0.7051	0.1301	0.0349	0.5037	0.0653	0.0400	0.5777	0.0749	0.0432	0.6226	0.0807	0.0400	0.5771	0.0748	0.0582	0.7557	0.1081	0.0588	0.7637	0.1092	0.0602	0.7824	0.1119	0.0598	0.7770	0.1111	0.1801	0.7682	0.2918	0.2135	0.9106	0.3459	0.1972	0.8410	0.3195	0.1805	0.7696	0.2924	0.2029	0.7082	0.3154	0.2144	0.7486	0.3334	0.2106	0.7350	0.3273	0.2043	0.7131	0.3176	0.2489	0.9002	0.3900	0.2547	0.9211	0.3991	0.2543	0.9198	0.3985	0.2514	0.9091	0.3939	0.1325	0.7911	0.2270	0.1503	0.8974	0.2575	0.1417	0.8460	0.2427	0.1327	0.7923	0.2273	0.0896	0.7056	0.1590	0.1020	0.8035	0.1811	0.0971	0.7644	0.1723	0.0905	0.7123	0.1605	0.1419	0.6841	0.2351	0.1515	0.7301	0.2509	0.1547	0.7459	0.2563	0.1496	0.7209	0.2477	0.2669	0.8138	0.4020	0.2713	0.8270	0.4085	0.2716	0.8280	0.4090	0.2691	0.8204	0.4053	0.1878	0.8711	0.3090	0.1969	0.9132	0.3240	0.1925	0.8925	0.3166	0.1879	0.8713	0.3091	0.0430	0.4920	0.0790	0.0467	0.5345	0.0858	0.0495	0.5664	0.0910	0.0471	0.5400	0.0867	0.2750	0.8925	0.4205	0.2805	0.9104	0.4289	0.2805	0.9102	0.4288	0.2771	0.8993	0.4237	0.1419	0.4662	0.2176	0.2111	0.6934	0.3237	0.1793	0.5888	0.2748	0.1433	0.4708	0.2197	0.1084	0.4946	0.1778	0.1089	0.4969	0.1786	0.1087	0.4961	0.1783	0.1085	0.4949	0.1779	0.0546	0.5024	0.0985	0.0607	0.5583	0.1095	0.0577	0.5308	0.1041	0.0547	0.5028	0.0986	0.2772	0.9012	0.4240	0.2814	0.9147	0.4303	0.2812	0.9140	0.4300	0.2789	0.9066	0.4265
0.1183	3.9991	2304	0.2222	0.7712	0.7242	0.7470	0.8549	0.8028	0.8280	0.8263	0.7760	0.8004	0.7818	0.7342	0.7573	0.2084	0.7666	0.3277	0.2273	0.8363	0.3575	0.2184	0.8036	0.3435	0.2087	0.7676	0.3281	0	0	0	0	0.1828	0.6501	0.2853	0.1989	0.7072	0.3104	0.1951	0.6938	0.3045	0.1860	0.6614	0.2903	0.1667	0.6458	0.2650	0.1835	0.7108	0.2917	0.1774	0.6871	0.2819	0.1687	0.6535	0.2682	0.1561	0.8691	0.2647	0.1571	0.8749	0.2664	0.1601	0.8915	0.2715	0.1593	0.8872	0.2702	0.2075	0.7712	0.3270	0.2447	0.9094	0.3856	0.2285	0.8490	0.3600	0.2086	0.7754	0.3288	0.0316	0.5720	0.0599	0.0332	0.6007	0.0629	0.0370	0.6692	0.0701	0.0356	0.6432	0.0674	0.1938	0.7166	0.3051	0.2388	0.8828	0.3759	0.2188	0.8088	0.3444	0.1952	0.7215	0.3072	0.2244	0.8406	0.3542	0.2388	0.8945	0.3769	0.2367	0.8867	0.3736	0.2285	0.8561	0.3607	0.1768	0.5366	0.2659	0.2428	0.7373	0.3654	0.2114	0.6419	0.3181	0.1777	0.5396	0.2674	0.0079	0.3247	0.0154	0.0110	0.4526	0.0215	0.0096	0.3933	0.0187	0.0080	0.3284	0.0156	0.1052	0.3312	0.1597	0.1685	0.5303	0.2557	0.1385	0.4360	0.2102	0.1055	0.3320	0.1601	0.2218	0.8298	0.3501	0.2383	0.8914	0.3761	0.2329	0.8712	0.3676	0.2246	0.8399	0.3544	0.0036	0.2528	0.0071	0.0062	0.4376	0.0122	0.0085	0.5995	0.0167	0.0065	0.4613	0.0129	0.1343	0.8352	0.2314	0.1353	0.8411	0.2331	0.1349	0.8390	0.2325	0.1344	0.8360	0.2316	0.2383	0.9111	0.3778	0.2451	0.9370	0.3886	0.2446	0.9351	0.3878	0.2402	0.9185	0.3809	0.0617	0.6199	0.1122	0.0660	0.6630	0.1200	0.0728	0.7309	0.1323	0.0699	0.7024	0.1272	0.0990	0.6713	0.1725	0.1117	0.7581	0.1948	0.1087	0.7375	0.1895	0.1018	0.6907	0.1775	0.0333	0.5071	0.0625	0.0377	0.5742	0.0708	0.0417	0.6340	0.0782	0.0390	0.5936	0.0732	0.0545	0.7693	0.1018	0.0554	0.7820	0.1035	0.0569	0.8036	0.1063	0.0563	0.7946	0.1052	0.1692	0.7598	0.2768	0.2027	0.9103	0.3316	0.1863	0.8365	0.3047	0.1695	0.7610	0.2772	0.1920	0.7064	0.3019	0.2032	0.7477	0.3196	0.1997	0.7346	0.3140	0.1935	0.7121	0.3044	0.2372	0.9049	0.3759	0.2429	0.9267	0.3850	0.2423	0.9241	0.3839	0.2394	0.9130	0.3793	0.1252	0.7886	0.2161	0.1418	0.8931	0.2447	0.1338	0.8429	0.2309	0.1253	0.7895	0.2163	0.0859	0.7286	0.1537	0.0966	0.8187	0.1728	0.0921	0.7813	0.1649	0.0864	0.7324	0.1545	0.1332	0.6740	0.2224	0.1424	0.7205	0.2378	0.1470	0.7439	0.2455	0.1416	0.7164	0.2365	0.2536	0.8179	0.3872	0.2575	0.8304	0.3931	0.2578	0.8315	0.3936	0.2558	0.8250	0.3905	0.1787	0.8776	0.2970	0.1866	0.9164	0.3101	0.1828	0.8973	0.3037	0.1788	0.8778	0.2971	0.0343	0.4608	0.0638	0.0374	0.5028	0.0696	0.0402	0.5401	0.0747	0.0381	0.5121	0.0709	0.2606	0.9028	0.4045	0.2664	0.9229	0.4135	0.2658	0.9207	0.4125	0.2624	0.9090	0.4072	0.1370	0.4778	0.2129	0.2008	0.7003	0.3121	0.1715	0.5980	0.2665	0.1378	0.4807	0.2142	0.0960	0.5064	0.1614	0.0966	0.5093	0.1623	0.0963	0.5082	0.1620	0.0961	0.5067	0.1615	0.0488	0.5349	0.0895	0.0546	0.5979	0.1000	0.0517	0.5669	0.0948	0.0489	0.5354	0.0896	0.2599	0.9170	0.4050	0.2645	0.9333	0.4122	0.2635	0.9299	0.4107	0.2611	0.9213	0.4069
0.1075	4.9989	2880	0.2295	0.7762	0.7231	0.7487	0.8596	0.8008	0.8292	0.8308	0.7739	0.8014	0.7865	0.7327	0.7587	0.2128	0.7719	0.3336	0.2315	0.8399	0.3630	0.2228	0.8083	0.3493	0.2131	0.7731	0.3341	0	0	0	0	0.1913	0.6493	0.2955	0.2078	0.7055	0.3211	0.2040	0.6925	0.3152	0.1944	0.6600	0.3004	0.1765	0.6338	0.2761	0.1940	0.6967	0.3035	0.1874	0.6731	0.2932	0.1784	0.6407	0.2791	0.1602	0.8672	0.2704	0.1618	0.8759	0.2731	0.1646	0.8909	0.2778	0.1636	0.8856	0.2762	0.2134	0.7731	0.3345	0.2513	0.9102	0.3938	0.2351	0.8515	0.3684	0.2149	0.7783	0.3368	0.0338	0.5634	0.0638	0.0350	0.5835	0.0661	0.0409	0.6814	0.0772	0.0394	0.6566	0.0744	0.1976	0.7104	0.3093	0.2449	0.8804	0.3833	0.2239	0.8049	0.3504	0.1992	0.7159	0.3116	0.2291	0.8361	0.3597	0.2451	0.8945	0.3848	0.2426	0.8854	0.3809	0.2335	0.8520	0.3665	0.1815	0.5380	0.2715	0.2476	0.7339	0.3703	0.2163	0.6411	0.3235	0.1826	0.5412	0.2731	0.0091	0.3208	0.0176	0.0122	0.4321	0.0237	0.0108	0.3818	0.0210	0.0092	0.3249	0.0178	0.1132	0.3394	0.1697	0.1790	0.5368	0.2685	0.1481	0.4442	0.2222	0.1136	0.3407	0.1704	0.2301	0.8402	0.3612	0.2459	0.8981	0.3861	0.2408	0.8794	0.3781	0.2327	0.8498	0.3653	0.0059	0.3719	0.0117	0.0073	0.4559	0.0143	0.0111	0.6932	0.0218	0.0099	0.6208	0.0195	0.1387	0.8349	0.2379	0.1397	0.8408	0.2395	0.1394	0.8389	0.2390	0.1389	0.8360	0.2382	0.2449	0.9070	0.3856	0.2517	0.9322	0.3964	0.2513	0.9307	0.3957	0.2469	0.9143	0.3888	0.0567	0.6540	0.1043	0.0617	0.7119	0.1136	0.0639	0.7373	0.1176	0.0610	0.7044	0.1124	0.1024	0.6694	0.1777	0.1161	0.7586	0.2013	0.1125	0.7353	0.1952	0.1052	0.6877	0.1825	0.0297	0.5217	0.0562	0.0337	0.5924	0.0638	0.0359	0.6299	0.0679	0.0337	0.5908	0.0637	0.0566	0.7610	0.1054	0.0576	0.7743	0.1072	0.0587	0.7899	0.1094	0.0581	0.7817	0.1082	0.1750	0.7632	0.2847	0.2082	0.9080	0.3387	0.1920	0.8374	0.3124	0.1754	0.7649	0.2853	0.2013	0.7109	0.3138	0.2125	0.7505	0.3312	0.2090	0.7380	0.3257	0.2028	0.7163	0.3161	0.2433	0.9058	0.3835	0.2485	0.9251	0.3917	0.2479	0.9229	0.3908	0.2452	0.9129	0.3866	0.1290	0.7919	0.2219	0.1467	0.9006	0.2523	0.1380	0.8474	0.2374	0.1291	0.7927	0.2221	0.0903	0.7243	0.1606	0.1013	0.8125	0.1802	0.0966	0.7742	0.1717	0.0907	0.7275	0.1613	0.1399	0.6590	0.2308	0.1494	0.7038	0.2464	0.1558	0.7342	0.2571	0.1502	0.7078	0.2479	0.2583	0.8286	0.3938	0.2616	0.8394	0.3989	0.2624	0.8418	0.4001	0.2605	0.8357	0.3972	0.1821	0.8803	0.3018	0.1910	0.9235	0.3166	0.1866	0.9022	0.3093	0.1822	0.8806	0.3019	0.0386	0.4791	0.0714	0.0413	0.5129	0.0764	0.0442	0.5496	0.0819	0.0425	0.5284	0.0787	0.2665	0.9049	0.4117	0.2719	0.9235	0.4202	0.2713	0.9215	0.4192	0.2681	0.9105	0.4142	0.1422	0.4749	0.2188	0.2091	0.6983	0.3218	0.1779	0.5943	0.2738	0.1429	0.4773	0.2199	0.1059	0.4913	0.1742	0.1066	0.4945	0.1754	0.1063	0.4932	0.1749	0.1059	0.4915	0.1743	0.0517	0.5178	0.0940	0.0581	0.5820	0.1057	0.0549	0.5503	0.0999	0.0517	0.5182	0.0941	0.2681	0.9188	0.4151	0.2720	0.9322	0.4211	0.2715	0.9304	0.4203	0.2694	0.9233	0.4171
0.0995	5.9987	3456	0.2363	0.7693	0.7307	0.7495	0.8515	0.8087	0.8295	0.8230	0.7817	0.8018	0.7796	0.7405	0.7595	0.2032	0.7627	0.3208	0.2220	0.8336	0.3507	0.2132	0.8005	0.3367	0.2035	0.7639	0.3214	0	0	0	0	0.1766	0.6533	0.2781	0.1930	0.7138	0.3039	0.1887	0.6980	0.2971	0.1796	0.6643	0.2828	0.1636	0.6538	0.2617	0.1793	0.7163	0.2868	0.1732	0.6919	0.2770	0.1651	0.6597	0.2641	0.1518	0.8730	0.2587	0.1528	0.8785	0.2603	0.1558	0.8956	0.2654	0.1551	0.8915	0.2642	0.2024	0.7736	0.3209	0.2387	0.9122	0.3784	0.2227	0.8513	0.3531	0.2036	0.7780	0.3227	0.0311	0.5299	0.0588	0.0325	0.5535	0.0614	0.0381	0.6494	0.0720	0.0364	0.6204	0.0688	0.1888	0.7146	0.2987	0.2331	0.8824	0.3688	0.2138	0.8091	0.3382	0.1903	0.7204	0.3011	0.2175	0.8370	0.3453	0.2327	0.8955	0.3695	0.2304	0.8864	0.3657	0.2218	0.8532	0.3520	0.1693	0.5549	0.2595	0.2311	0.7574	0.3541	0.2014	0.6602	0.3087	0.1701	0.5574	0.2606	0.0071	0.3371	0.0138	0.0098	0.4685	0.0192	0.0085	0.4074	0.0167	0.0071	0.3402	0.0140	0.1046	0.3351	0.1595	0.1659	0.5315	0.2529	0.1370	0.4389	0.2088	0.1049	0.3359	0.1598	0.2172	0.8458	0.3457	0.2318	0.9024	0.3688	0.2271	0.8843	0.3614	0.2197	0.8553	0.3495	0.0067	0.3934	0.0133	0.0079	0.4590	0.0155	0.0121	0.7049	0.0237	0.0111	0.6482	0.0218	0.1310	0.8301	0.2263	0.1319	0.8363	0.2279	0.1316	0.8342	0.2274	0.1311	0.8311	0.2265	0.2331	0.9142	0.3715	0.2392	0.9382	0.3812	0.2388	0.9366	0.3806	0.2349	0.9212	0.3743	0.0552	0.6401	0.1017	0.0597	0.6924	0.1100	0.0639	0.7404	0.1176	0.0612	0.7092	0.1126	0.0953	0.7023	0.1678	0.1080	0.7958	0.1902	0.1044	0.7691	0.1838	0.0975	0.7186	0.1717	0.0260	0.5481	0.0497	0.0291	0.6127	0.0556	0.0310	0.6535	0.0593	0.0293	0.6176	0.0560	0.0533	0.7604	0.0995	0.0541	0.7725	0.1011	0.0552	0.7883	0.1032	0.0547	0.7811	0.1022	0.1654	0.7647	0.2720	0.1975	0.9130	0.3247	0.1819	0.8410	0.2991	0.1658	0.7667	0.2727	0.1856	0.7132	0.2945	0.1964	0.7545	0.3116	0.1929	0.7413	0.3062	0.1871	0.7188	0.2969	0.2327	0.9043	0.3702	0.2375	0.9228	0.3778	0.2372	0.9217	0.3773	0.2347	0.9121	0.3734	0.1222	0.7919	0.2118	0.1384	0.8964	0.2397	0.1304	0.8448	0.2259	0.1223	0.7921	0.2118	0.0840	0.7515	0.1510	0.0940	0.8409	0.1690	0.0893	0.7996	0.1607	0.0842	0.7535	0.1514	0.1282	0.6879	0.2161	0.1368	0.7339	0.2306	0.1414	0.7587	0.2384	0.1367	0.7333	0.2304	0.2453	0.8437	0.3801	0.2484	0.8544	0.3849	0.2490	0.8566	0.3859	0.2473	0.8507	0.3832	0.1732	0.8703	0.2889	0.1820	0.9147	0.3036	0.1777	0.8928	0.2964	0.1732	0.8706	0.2890	0.0330	0.4712	0.0617	0.0355	0.5066	0.0663	0.0383	0.5463	0.0715	0.0366	0.5231	0.0685	0.2570	0.8993	0.3998	0.2621	0.9170	0.4076	0.2619	0.9163	0.4073	0.2588	0.9055	0.4025	0.1293	0.4695	0.2028	0.1922	0.6978	0.3014	0.1630	0.5918	0.2556	0.1305	0.4738	0.2046	0.0926	0.5101	0.1567	0.0931	0.5131	0.1576	0.0929	0.5119	0.1572	0.0926	0.5104	0.1568	0.0457	0.5450	0.0844	0.0511	0.6091	0.0943	0.0485	0.5776	0.0894	0.0458	0.5455	0.0845	0.2583	0.9083	0.4022	0.2621	0.9214	0.4081	0.2618	0.9204	0.4076	0.2597	0.9132	0.4044
0.0896	6.9985	4032	0.2378	0.7710	0.7291	0.7495	0.8540	0.8077	0.8302	0.8254	0.7807	0.8024	0.7816	0.7392	0.7598	0.2049	0.7717	0.3238	0.2234	0.8413	0.3530	0.2147	0.8086	0.3393	0.2052	0.7729	0.3243	0.0	0.0	0.0	0.0	0.1801	0.6560	0.2827	0.1965	0.7156	0.3083	0.1923	0.7001	0.3017	0.1830	0.6666	0.2872	0.1636	0.6613	0.2624	0.1803	0.7286	0.2890	0.1738	0.7022	0.2786	0.1652	0.6676	0.2649	0.1543	0.8689	0.2620	0.1555	0.8757	0.2641	0.1588	0.8942	0.2697	0.1579	0.8893	0.2682	0.2057	0.7720	0.3249	0.2427	0.9109	0.3833	0.2267	0.8508	0.3580	0.2070	0.7769	0.3269	0.0314	0.5426	0.0594	0.0331	0.5715	0.0626	0.0380	0.6564	0.0719	0.0363	0.6271	0.0687	0.1918	0.7134	0.3023	0.2369	0.8814	0.3735	0.2171	0.8076	0.3422	0.1934	0.7194	0.3048	0.2216	0.8427	0.3509	0.2367	0.9003	0.3749	0.2343	0.8912	0.3711	0.2258	0.8586	0.3575	0.1773	0.5483	0.2679	0.2411	0.7456	0.3643	0.2107	0.6515	0.3184	0.1782	0.5512	0.2693	0.0076	0.3167	0.0148	0.0103	0.4303	0.0201	0.0091	0.3786	0.0177	0.0077	0.3195	0.0150	0.1071	0.3343	0.1622	0.1703	0.5314	0.2579	0.1405	0.4384	0.2128	0.1074	0.3352	0.1627	0.2223	0.8476	0.3523	0.2366	0.9020	0.3749	0.2321	0.8849	0.3678	0.2248	0.8568	0.3561	0.0066	0.3791	0.0131	0.0076	0.4358	0.0150	0.0124	0.7059	0.0243	0.0114	0.6537	0.0225	0.1334	0.8352	0.2300	0.1343	0.8410	0.2316	0.1340	0.8391	0.2311	0.1335	0.8362	0.2303	0.2369	0.9127	0.3761	0.2433	0.9374	0.3863	0.2428	0.9358	0.3856	0.2388	0.9202	0.3792	0.0590	0.6360	0.1080	0.0631	0.6801	0.1155	0.0683	0.7364	0.1250	0.0657	0.7083	0.1203	0.0977	0.7106	0.1718	0.1105	0.8035	0.1943	0.1063	0.7732	0.1870	0.0997	0.7248	0.1753	0.0291	0.5004	0.0550	0.0332	0.5714	0.0628	0.0361	0.6215	0.0683	0.0337	0.5799	0.0637	0.0543	0.7627	0.1013	0.0551	0.7736	0.1028	0.0564	0.7926	0.1053	0.0560	0.7864	0.1045	0.1693	0.7670	0.2773	0.2016	0.9134	0.3303	0.1859	0.8422	0.3045	0.1697	0.7688	0.2780	0.1904	0.7139	0.3006	0.2014	0.7550	0.3179	0.1978	0.7416	0.3123	0.1919	0.7194	0.3029	0.2353	0.9076	0.3737	0.2406	0.9280	0.3821	0.2398	0.9250	0.3809	0.2371	0.9145	0.3766	0.1241	0.7869	0.2144	0.1411	0.8947	0.2437	0.1327	0.8418	0.2293	0.1242	0.7875	0.2145	0.0859	0.7617	0.1543	0.0958	0.8496	0.1721	0.0912	0.8090	0.1639	0.0861	0.7639	0.1547	0.1334	0.6700	0.2225	0.1427	0.7166	0.2380	0.1472	0.7395	0.2456	0.1420	0.7130	0.2368	0.2502	0.8408	0.3856	0.2533	0.8515	0.3905	0.2541	0.8539	0.3916	0.2523	0.8480	0.3889	0.1772	0.8819	0.2952	0.1854	0.9226	0.3088	0.1814	0.9026	0.3021	0.1773	0.8821	0.2953	0.0345	0.4650	0.0641	0.0367	0.4957	0.0684	0.0401	0.5418	0.0747	0.0386	0.5205	0.0718	0.2589	0.9035	0.4024	0.2638	0.9208	0.4101	0.2636	0.9200	0.4098	0.2606	0.9096	0.4052	0.1322	0.4635	0.2058	0.1990	0.6976	0.3097	0.1677	0.5880	0.2610	0.1334	0.4676	0.2076	0.0928	0.5146	0.1572	0.0933	0.5174	0.1581	0.0931	0.5164	0.1577	0.0928	0.5150	0.1573	0.0491	0.5099	0.0896	0.0555	0.5754	0.1012	0.0523	0.5431	0.0955	0.0492	0.5103	0.0897	0.2588	0.9196	0.4039	0.2624	0.9325	0.4096	0.2620	0.9311	0.4089	0.2600	0.9241	0.4059
0.0873	7.9983	4608	0.2420	0.7745	0.7279	0.7505	0.8569	0.8054	0.8304	0.8287	0.7789	0.8031	0.7852	0.7380	0.7608	0.2097	0.7668	0.3294	0.2289	0.8369	0.3595	0.2199	0.8041	0.3454	0.2101	0.7680	0.3299	0.0	0.0	0.0	0.0	0.1849	0.6568	0.2886	0.2013	0.7152	0.3142	0.1972	0.7004	0.3077	0.1879	0.6676	0.2933	0.1695	0.6543	0.2692	0.1865	0.7199	0.2962	0.1798	0.6943	0.2857	0.1711	0.6606	0.2718	0.1575	0.8711	0.2667	0.1586	0.8773	0.2686	0.1616	0.8942	0.2738	0.1608	0.8898	0.2724	0.2099	0.7743	0.3302	0.2471	0.9117	0.3888	0.2311	0.8526	0.3637	0.2113	0.7796	0.3325	0.0322	0.5360	0.0608	0.0338	0.5622	0.0638	0.0392	0.6526	0.0740	0.0376	0.6258	0.0710	0.1952	0.7132	0.3065	0.2413	0.8818	0.3789	0.2210	0.8075	0.3470	0.1968	0.7191	0.3090	0.2259	0.8409	0.3561	0.2412	0.8979	0.3802	0.2388	0.8889	0.3764	0.2301	0.8566	0.3628	0.1816	0.5472	0.2727	0.2468	0.7437	0.3706	0.2157	0.6501	0.3240	0.1826	0.5502	0.2742	0.0082	0.3364	0.0159	0.0106	0.4364	0.0206	0.0095	0.3916	0.0185	0.0082	0.3402	0.0161	0.1120	0.3387	0.1684	0.1762	0.5326	0.2647	0.1462	0.4419	0.2197	0.1124	0.3397	0.1689	0.2272	0.8456	0.3582	0.2414	0.8982	0.3805	0.2371	0.8822	0.3737	0.2297	0.8550	0.3622	0.0072	0.3792	0.0140	0.0083	0.4402	0.0163	0.0131	0.6962	0.0258	0.0122	0.6459	0.0239	0.1361	0.8345	0.2340	0.1371	0.8404	0.2357	0.1367	0.8384	0.2351	0.1363	0.8355	0.2343	0.2412	0.9120	0.3815	0.2478	0.9369	0.3919	0.2472	0.9349	0.3911	0.2431	0.9192	0.3845	0.0585	0.6388	0.1072	0.0629	0.6869	0.1152	0.0674	0.7361	0.1235	0.0648	0.7076	0.1187	0.0996	0.7072	0.1746	0.1127	0.8005	0.1976	0.1086	0.7708	0.1903	0.1017	0.7220	0.1783	0.0290	0.5071	0.0548	0.0327	0.5723	0.0619	0.0357	0.6249	0.0676	0.0335	0.5861	0.0634	0.0559	0.7665	0.1042	0.0566	0.7768	0.1056	0.0580	0.7949	0.1080	0.0575	0.7886	0.1072	0.1727	0.7689	0.2820	0.2053	0.9142	0.3353	0.1894	0.8433	0.3093	0.1730	0.7704	0.2826	0.1949	0.7128	0.3061	0.2060	0.7534	0.3235	0.2024	0.7404	0.3180	0.1964	0.7183	0.3085	0.2393	0.9082	0.3788	0.2450	0.9296	0.3878	0.2441	0.9262	0.3863	0.2412	0.9154	0.3818	0.1269	0.7926	0.2187	0.1438	0.8982	0.2478	0.1355	0.8464	0.2336	0.1270	0.7932	0.2189	0.0875	0.7603	0.1570	0.0977	0.8485	0.1752	0.0930	0.8081	0.1668	0.0878	0.7626	0.1574	0.1339	0.6758	0.2235	0.1429	0.7212	0.2385	0.1479	0.7465	0.2469	0.1428	0.7206	0.2383	0.2560	0.8330	0.3917	0.2591	0.8430	0.3964	0.2601	0.8463	0.3979	0.2583	0.8406	0.3952	0.1803	0.8767	0.2991	0.1890	0.9193	0.3136	0.1847	0.8983	0.3064	0.1803	0.8770	0.2991	0.0357	0.4683	0.0664	0.0379	0.4970	0.0704	0.0416	0.5455	0.0773	0.0399	0.5234	0.0742	0.2628	0.9065	0.4075	0.2678	0.9237	0.4152	0.2676	0.9230	0.4149	0.2646	0.9128	0.4103	0.1384	0.4768	0.2145	0.2033	0.7004	0.3151	0.1733	0.5972	0.2687	0.1396	0.4811	0.2164	0.1020	0.4973	0.1693	0.1027	0.5006	0.1705	0.1024	0.4992	0.1700	0.1021	0.4976	0.1694	0.0497	0.5110	0.0905	0.0562	0.5784	0.1025	0.0530	0.5451	0.0966	0.0497	0.5114	0.0906	0.2629	0.9177	0.4087	0.2671	0.9322	0.4152	0.2665	0.9304	0.4144	0.2643	0.9227	0.4109

Framework versions

Transformers 4.40.2
Pytorch 2.3.1+cu121
Datasets 2.20.0
Tokenizers 0.19.1

nttaii
/

bert-base-multilingual-cased-iob2-20240810154618

bert-base-multilingual-cased-iob2-20240810154618

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

Model tree for nttaii/bert-base-multilingual-cased-iob2-20240810154618

Evaluation results