model push

README.md

@@ -1,3 +1,124 @@
 ---
 license: mit
+base_model: microsoft/deberta-v3-large
+tags:
+- generated_from_trainer
+model-index:
+- name: bbc-ner-deberta-large_baseline2_dims
+  results: []
 ---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# bbc-ner-deberta-large_baseline2_dims
+
+This model is a fine-tuned version of [microsoft/deberta-v3-large](https://huggingface.co/microsoft/deberta-v3-large) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.1481
+- Cargo Dimension Precision: 0.7606
+- Cargo Dimension Recall: 0.9474
+- Cargo Dimension F1: 0.8437
+- Cargo Dimension Number: 114
+- Cargo Quantity Precision: 0.8079
+- Cargo Quantity Recall: 0.8937
+- Cargo Quantity F1: 0.8486
+- Cargo Quantity Number: 207
+- Cargo Requirements Precision: 0.4962
+- Cargo Requirements Recall: 0.6535
+- Cargo Requirements F1: 0.5641
+- Cargo Requirements Number: 202
+- Cargo Stowage Factor Precision: 0.8226
+- Cargo Stowage Factor Recall: 0.8361
+- Cargo Stowage Factor F1: 0.8293
+- Cargo Stowage Factor Number: 122
+- Cargo Type Precision: 0.7885
+- Cargo Type Recall: 0.8183
+- Cargo Type F1: 0.8031
+- Cargo Type Number: 688
+- Cargo Weigh Volume Precision: 0.8528
+- Cargo Weigh Volume Recall: 0.9026
+- Cargo Weigh Volume F1: 0.8770
+- Cargo Weigh Volume Number: 719
+- Commission Rate Precision: 0.7955
+- Commission Rate Recall: 0.8452
+- Commission Rate F1: 0.8196
+- Commission Rate Number: 336
+- Discharging Port Precision: 0.8706
+- Discharging Port Recall: 0.9015
+- Discharging Port F1: 0.8858
+- Discharging Port Number: 843
+- Laycan Date Precision: 0.8260
+- Laycan Date Recall: 0.8710
+- Laycan Date F1: 0.8479
+- Laycan Date Number: 496
+- Loading Discharging Terms Precision: 0.7211
+- Loading Discharging Terms Recall: 0.7975
+- Loading Discharging Terms F1: 0.7574
+- Loading Discharging Terms Number: 321
+- Loading Port Precision: 0.8906
+- Loading Port Recall: 0.9232
+- Loading Port F1: 0.9066
+- Loading Port Number: 899
+- Shipment Terms Precision: 0.6780
+- Shipment Terms Recall: 0.6780
+- Shipment Terms F1: 0.6780
+- Shipment Terms Number: 118
+- Vessel Requirements Precision: 0.3786
+- Vessel Requirements Recall: 0.5132
+- Vessel Requirements F1: 0.4358
+- Vessel Requirements Number: 76
+- Overall Precision: 0.8041
+- Overall Recall: 0.8598
+- Overall F1: 0.8310
+- Overall Accuracy: 0.9688
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- gradient_accumulation_steps: 2
+- total_train_batch_size: 16
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 10.0
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Cargo Dimension Precision | Cargo Dimension Recall | Cargo Dimension F1 | Cargo Dimension Number | Cargo Quantity Precision | Cargo Quantity Recall | Cargo Quantity F1 | Cargo Quantity Number | Cargo Requirements Precision | Cargo Requirements Recall | Cargo Requirements F1 | Cargo Requirements Number | Cargo Stowage Factor Precision | Cargo Stowage Factor Recall | Cargo Stowage Factor F1 | Cargo Stowage Factor Number | Cargo Type Precision | Cargo Type Recall | Cargo Type F1 | Cargo Type Number | Cargo Weigh Volume Precision | Cargo Weigh Volume Recall | Cargo Weigh Volume F1 | Cargo Weigh Volume Number | Commission Rate Precision | Commission Rate Recall | Commission Rate F1 | Commission Rate Number | Discharging Port Precision | Discharging Port Recall | Discharging Port F1 | Discharging Port Number | Laycan Date Precision | Laycan Date Recall | Laycan Date F1 | Laycan Date Number | Loading Discharging Terms Precision | Loading Discharging Terms Recall | Loading Discharging Terms F1 | Loading Discharging Terms Number | Loading Port Precision | Loading Port Recall | Loading Port F1 | Loading Port Number | Shipment Terms Precision | Shipment Terms Recall | Shipment Terms F1 | Shipment Terms Number | Vessel Requirements Precision | Vessel Requirements Recall | Vessel Requirements F1 | Vessel Requirements Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
+|:-------------:|:-----:|:----:|:---------------:|:-------------------------:|:----------------------:|:------------------:|:----------------------:|:------------------------:|:---------------------:|:-----------------:|:---------------------:|:----------------------------:|:-------------------------:|:---------------------:|:-------------------------:|:------------------------------:|:---------------------------:|:-----------------------:|:---------------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:----------------------------:|:-------------------------:|:---------------------:|:-------------------------:|:-------------------------:|:----------------------:|:------------------:|:----------------------:|:--------------------------:|:-----------------------:|:-------------------:|:-----------------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-----------------------------------:|:--------------------------------:|:----------------------------:|:--------------------------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:------------------------:|:---------------------:|:-----------------:|:---------------------:|:-----------------------------:|:--------------------------:|:----------------------:|:--------------------------:|:-----------------:|:--------------:|:----------:|:----------------:|
+| 0.4476        | 1.0   | 119  | 0.1523          | 0.6169                    | 0.8333                 | 0.7090             | 114                    | 0.7087                   | 0.8696                | 0.7809            | 207                   | 0.3007                       | 0.4257                    | 0.3525                | 202                       | 0.6284                         | 0.7623                      | 0.6889                  | 122                         | 0.6478               | 0.6308            | 0.6392        | 688               | 0.6983                       | 0.8178                    | 0.7534                | 719                       | 0.7099                    | 0.7649                 | 0.7364             | 336                    | 0.7212                     | 0.8683                  | 0.7879              | 843                     | 0.7482                | 0.8266             | 0.7854         | 496                | 0.5669                              | 0.6729                           | 0.6154                       | 321                              | 0.8280                 | 0.8565              | 0.8420          | 899                 | 0.6556                   | 0.5                   | 0.5673            | 118                   | 0.0658                        | 0.0658                     | 0.0658                 | 76                         | 0.6819            | 0.7635         | 0.7204     | 0.9581           |
+| 0.132         | 2.0   | 239  | 0.1438          | 0.6471                    | 0.8684                 | 0.7416             | 114                    | 0.7212                   | 0.9372                | 0.8151            | 207                   | 0.2857                       | 0.4455                    | 0.3482                | 202                       | 0.7083                         | 0.8361                      | 0.7669                  | 122                         | 0.6586               | 0.8270            | 0.7332        | 688               | 0.7191                       | 0.8901                    | 0.7955                | 719                       | 0.7863                    | 0.8542                 | 0.8188             | 336                    | 0.7639                     | 0.8944                  | 0.8240              | 843                     | 0.7370                | 0.8589             | 0.7933         | 496                | 0.5497                              | 0.7757                           | 0.6434                       | 321                              | 0.8533                 | 0.8932              | 0.8728          | 899                 | 0.5669                   | 0.6102                | 0.5878            | 118                   | 0.216                         | 0.3553                     | 0.2687                 | 76                         | 0.6943            | 0.8387         | 0.7597     | 0.9579           |
+| 0.1022        | 3.0   | 358  | 0.1217          | 0.7574                    | 0.9035                 | 0.8240             | 114                    | 0.8087                   | 0.8986                | 0.8513            | 207                   | 0.4081                       | 0.5495                    | 0.4684                | 202                       | 0.75                           | 0.8361                      | 0.7907                  | 122                         | 0.7301               | 0.8140            | 0.7698        | 688               | 0.8132                       | 0.8720                    | 0.8416                | 719                       | 0.7983                    | 0.8482                 | 0.8225             | 336                    | 0.8123                     | 0.9087                  | 0.8578              | 843                     | 0.7901                | 0.8730             | 0.8295         | 496                | 0.7583                              | 0.7819                           | 0.7699                       | 321                              | 0.8783                 | 0.9232              | 0.9002          | 899                 | 0.7596                   | 0.6695                | 0.7117            | 118                   | 0.3529                        | 0.4737                     | 0.4045                 | 76                         | 0.7744            | 0.8498         | 0.8103     | 0.9677           |
+| 0.0802        | 4.0   | 478  | 0.1291          | 0.7589                    | 0.9386                 | 0.8392             | 114                    | 0.8097                   | 0.8841                | 0.8453            | 207                   | 0.4566                       | 0.5990                    | 0.5182                | 202                       | 0.8347                         | 0.8279                      | 0.8313                  | 122                         | 0.7710               | 0.7733            | 0.7721        | 688               | 0.8015                       | 0.8818                    | 0.8397                | 719                       | 0.8203                    | 0.8423                 | 0.8311             | 336                    | 0.8449                     | 0.9110                  | 0.8767              | 843                     | 0.8252                | 0.8851             | 0.8541         | 496                | 0.7202                              | 0.7539                           | 0.7367                       | 321                              | 0.8637                 | 0.9232              | 0.8925          | 899                 | 0.7404                   | 0.6525                | 0.6937            | 118                   | 0.4359                        | 0.4474                     | 0.4416                 | 76                         | 0.7912            | 0.8463         | 0.8179     | 0.9683           |
+| 0.0733        | 5.0   | 597  | 0.1269          | 0.7347                    | 0.9474                 | 0.8276             | 114                    | 0.7975                   | 0.9130                | 0.8514            | 207                   | 0.4306                       | 0.6139                    | 0.5061                | 202                       | 0.8062                         | 0.8525                      | 0.8287                  | 122                         | 0.7564               | 0.8169            | 0.7855        | 688               | 0.8142                       | 0.8901                    | 0.8505                | 719                       | 0.8184                    | 0.8452                 | 0.8316             | 336                    | 0.8760                     | 0.9051                  | 0.8903              | 843                     | 0.8180                | 0.8790             | 0.8474         | 496                | 0.7303                              | 0.8100                           | 0.7681                       | 321                              | 0.8747                 | 0.9321              | 0.9025          | 899                 | 0.6231                   | 0.6864                | 0.6532            | 118                   | 0.3407                        | 0.4079                     | 0.3713                 | 76                         | 0.7870            | 0.8598         | 0.8218     | 0.9681           |
+| 0.0541        | 6.0   | 717  | 0.1299          | 0.7379                    | 0.9386                 | 0.8263             | 114                    | 0.7899                   | 0.9082                | 0.8449            | 207                   | 0.4330                       | 0.6238                    | 0.5112                | 202                       | 0.8095                         | 0.8361                      | 0.8226                  | 122                         | 0.7681               | 0.8183            | 0.7924        | 688               | 0.7916                       | 0.8929                    | 0.8392                | 719                       | 0.8182                    | 0.8571                 | 0.8372             | 336                    | 0.8491                     | 0.9075                  | 0.8773              | 843                     | 0.8056                | 0.8690             | 0.8361         | 496                | 0.6981                              | 0.7850                           | 0.7390                       | 321                              | 0.8828                 | 0.9388              | 0.9100          | 899                 | 0.6991                   | 0.6695                | 0.6840            | 118                   | 0.38                          | 0.5                        | 0.4318                 | 76                         | 0.7815            | 0.8607         | 0.8192     | 0.9676           |
+| 0.0463        | 7.0   | 836  | 0.1311          | 0.7626                    | 0.9298                 | 0.8379             | 114                    | 0.8243                   | 0.8841                | 0.8531            | 207                   | 0.4731                       | 0.6089                    | 0.5325                | 202                       | 0.7895                         | 0.8607                      | 0.8235                  | 122                         | 0.7875               | 0.7863            | 0.7869        | 688               | 0.8366                       | 0.8901                    | 0.8625                | 719                       | 0.8067                    | 0.8571                 | 0.8312             | 336                    | 0.8928                     | 0.8992                  | 0.8960              | 843                     | 0.8314                | 0.8649             | 0.8478         | 496                | 0.7672                              | 0.8006                           | 0.7835                       | 321                              | 0.9013                 | 0.9143              | 0.9078          | 899                 | 0.6529                   | 0.6695                | 0.6611            | 118                   | 0.3608                        | 0.4605                     | 0.4046                 | 76                         | 0.8096            | 0.8493         | 0.8289     | 0.9686           |
+| 0.0434        | 8.0   | 956  | 0.1430          | 0.7448                    | 0.9474                 | 0.8340             | 114                    | 0.7957                   | 0.9034                | 0.8462            | 207                   | 0.4765                       | 0.6535                    | 0.5511                | 202                       | 0.7863                         | 0.8443                      | 0.8142                  | 122                         | 0.7916               | 0.8227            | 0.8068        | 688               | 0.8274                       | 0.8999                    | 0.8621                | 719                       | 0.8141                    | 0.8601                 | 0.8365             | 336                    | 0.8727                     | 0.9027                  | 0.8875              | 843                     | 0.8241                | 0.8690             | 0.8459         | 496                | 0.7298                              | 0.8162                           | 0.7706                       | 321                              | 0.8943                 | 0.9132              | 0.9037          | 899                 | 0.5797                   | 0.6780                | 0.6250            | 118                   | 0.3491                        | 0.4868                     | 0.4066                 | 76                         | 0.7963            | 0.8605         | 0.8271     | 0.9681           |
+| 0.0373        | 9.0   | 1075 | 0.1435          | 0.75                      | 0.9474                 | 0.8372             | 114                    | 0.8017                   | 0.8986                | 0.8474            | 207                   | 0.4815                       | 0.6436                    | 0.5508                | 202                       | 0.8254                         | 0.8525                      | 0.8387                  | 122                         | 0.7762               | 0.8169            | 0.7960        | 688               | 0.8409                       | 0.9040                    | 0.8713                | 719                       | 0.8011                    | 0.8512                 | 0.8254             | 336                    | 0.8648                     | 0.8956                  | 0.8800              | 843                     | 0.8267                | 0.875              | 0.8501         | 496                | 0.7227                              | 0.8037                           | 0.7611                       | 321                              | 0.8874                 | 0.9288              | 0.9076          | 899                 | 0.6349                   | 0.6780                | 0.6557            | 118                   | 0.3645                        | 0.5132                     | 0.4262                 | 76                         | 0.7969            | 0.8611         | 0.8278     | 0.9686           |
+| 0.0348        | 9.96  | 1190 | 0.1481          | 0.7606                    | 0.9474                 | 0.8437             | 114                    | 0.8079                   | 0.8937                | 0.8486            | 207                   | 0.4962                       | 0.6535                    | 0.5641                | 202                       | 0.8226                         | 0.8361                      | 0.8293                  | 122                         | 0.7885               | 0.8183            | 0.8031        | 688               | 0.8528                       | 0.9026                    | 0.8770                | 719                       | 0.7955                    | 0.8452                 | 0.8196             | 336                    | 0.8706                     | 0.9015                  | 0.8858              | 843                     | 0.8260                | 0.8710             | 0.8479         | 496                | 0.7211                              | 0.7975                           | 0.7574                       | 321                              | 0.8906                 | 0.9232              | 0.9066          | 899                 | 0.6780                   | 0.6780                | 0.6780            | 118                   | 0.3786                        | 0.5132                     | 0.4358                 | 76                         | 0.8041            | 0.8598         | 0.8310     | 0.9688           |
+
+
+### Framework versions
+
+- Transformers 4.36.0.dev0
+- Pytorch 2.1.0+cu121
+- Datasets 2.14.5
+- Tokenizers 0.15.0

added_tokens.json

@@ -0,0 +1,3 @@
+{
+  "[MASK]": 128000
+}

all_results.json

@@ -0,0 +1,129 @@
+{
+    "epoch": 9.96,
+    "eval_Cargo_Dimension_f1": 0.8437499999999999,
+    "eval_Cargo_Dimension_number": 114,
+    "eval_Cargo_Dimension_precision": 0.7605633802816901,
+    "eval_Cargo_Dimension_recall": 0.9473684210526315,
+    "eval_Cargo_Quantity_f1": 0.8486238532110092,
+    "eval_Cargo_Quantity_number": 207,
+    "eval_Cargo_Quantity_precision": 0.8078602620087336,
+    "eval_Cargo_Quantity_recall": 0.893719806763285,
+    "eval_Cargo_Requirements_f1": 0.5641025641025641,
+    "eval_Cargo_Requirements_number": 202,
+    "eval_Cargo_Requirements_precision": 0.49624060150375937,
+    "eval_Cargo_Requirements_recall": 0.6534653465346535,
+    "eval_Cargo_Stowage_Factor_f1": 0.829268292682927,
+    "eval_Cargo_Stowage_Factor_number": 122,
+    "eval_Cargo_Stowage_Factor_precision": 0.8225806451612904,
+    "eval_Cargo_Stowage_Factor_recall": 0.8360655737704918,
+    "eval_Cargo_Type_f1": 0.8031383737517832,
+    "eval_Cargo_Type_number": 688,
+    "eval_Cargo_Type_precision": 0.788515406162465,
+    "eval_Cargo_Type_recall": 0.8183139534883721,
+    "eval_Cargo_Weigh_Volume_f1": 0.8770270270270271,
+    "eval_Cargo_Weigh_Volume_number": 719,
+    "eval_Cargo_Weigh_Volume_precision": 0.8528252299605782,
+    "eval_Cargo_Weigh_Volume_recall": 0.9026425591098748,
+    "eval_Commission_rate_f1": 0.8196248196248196,
+    "eval_Commission_rate_number": 336,
+    "eval_Commission_rate_precision": 0.7955182072829131,
+    "eval_Commission_rate_recall": 0.8452380952380952,
+    "eval_Discharging_port_f1": 0.8857808857808858,
+    "eval_Discharging_port_number": 843,
+    "eval_Discharging_port_precision": 0.870561282932417,
+    "eval_Discharging_port_recall": 0.9015421115065243,
+    "eval_Laycan_date_f1": 0.8478900883218843,
+    "eval_Laycan_date_number": 496,
+    "eval_Laycan_date_precision": 0.8260038240917782,
+    "eval_Laycan_date_recall": 0.8709677419354839,
+    "eval_Loading_Discharging_terms_f1": 0.757396449704142,
+    "eval_Loading_Discharging_terms_number": 321,
+    "eval_Loading_Discharging_terms_precision": 0.7211267605633803,
+    "eval_Loading_Discharging_terms_recall": 0.7975077881619937,
+    "eval_Loading_port_f1": 0.9066084107045331,
+    "eval_Loading_port_number": 899,
+    "eval_Loading_port_precision": 0.8905579399141631,
+    "eval_Loading_port_recall": 0.9232480533926585,
+    "eval_Shipment_terms_f1": 0.6779661016949152,
+    "eval_Shipment_terms_number": 118,
+    "eval_Shipment_terms_precision": 0.6779661016949152,
+    "eval_Shipment_terms_recall": 0.6779661016949152,
+    "eval_Vessel_Requirements_f1": 0.4357541899441341,
+    "eval_Vessel_Requirements_number": 76,
+    "eval_Vessel_Requirements_precision": 0.3786407766990291,
+    "eval_Vessel_Requirements_recall": 0.5131578947368421,
+    "eval_loss": 0.14810970425605774,
+    "eval_overall_accuracy": 0.9687605197603177,
+    "eval_overall_f1": 0.8309832675314909,
+    "eval_overall_precision": 0.8040749499727123,
+    "eval_overall_recall": 0.859754911495818,
+    "eval_runtime": 19.0868,
+    "eval_samples": 477,
+    "eval_samples_per_second": 24.991,
+    "eval_steps_per_second": 3.144,
+    "predict_Cargo_Dimension_f1": 0.8437499999999999,
+    "predict_Cargo_Dimension_number": 114,
+    "predict_Cargo_Dimension_precision": 0.7605633802816901,
+    "predict_Cargo_Dimension_recall": 0.9473684210526315,
+    "predict_Cargo_Quantity_f1": 0.8486238532110092,
+    "predict_Cargo_Quantity_number": 207,
+    "predict_Cargo_Quantity_precision": 0.8078602620087336,
+    "predict_Cargo_Quantity_recall": 0.893719806763285,
+    "predict_Cargo_Requirements_f1": 0.5641025641025641,
+    "predict_Cargo_Requirements_number": 202,
+    "predict_Cargo_Requirements_precision": 0.49624060150375937,
+    "predict_Cargo_Requirements_recall": 0.6534653465346535,
+    "predict_Cargo_Stowage_Factor_f1": 0.829268292682927,
+    "predict_Cargo_Stowage_Factor_number": 122,
+    "predict_Cargo_Stowage_Factor_precision": 0.8225806451612904,
+    "predict_Cargo_Stowage_Factor_recall": 0.8360655737704918,
+    "predict_Cargo_Type_f1": 0.8031383737517832,
+    "predict_Cargo_Type_number": 688,
+    "predict_Cargo_Type_precision": 0.788515406162465,
+    "predict_Cargo_Type_recall": 0.8183139534883721,
+    "predict_Cargo_Weigh_Volume_f1": 0.8770270270270271,
+    "predict_Cargo_Weigh_Volume_number": 719,
+    "predict_Cargo_Weigh_Volume_precision": 0.8528252299605782,
+    "predict_Cargo_Weigh_Volume_recall": 0.9026425591098748,
+    "predict_Commission_rate_f1": 0.8196248196248196,
+    "predict_Commission_rate_number": 336,
+    "predict_Commission_rate_precision": 0.7955182072829131,
+    "predict_Commission_rate_recall": 0.8452380952380952,
+    "predict_Discharging_port_f1": 0.8857808857808858,
+    "predict_Discharging_port_number": 843,
+    "predict_Discharging_port_precision": 0.870561282932417,
+    "predict_Discharging_port_recall": 0.9015421115065243,
+    "predict_Laycan_date_f1": 0.8478900883218843,
+    "predict_Laycan_date_number": 496,
+    "predict_Laycan_date_precision": 0.8260038240917782,
+    "predict_Laycan_date_recall": 0.8709677419354839,
+    "predict_Loading_Discharging_terms_f1": 0.757396449704142,
+    "predict_Loading_Discharging_terms_number": 321,
+    "predict_Loading_Discharging_terms_precision": 0.7211267605633803,
+    "predict_Loading_Discharging_terms_recall": 0.7975077881619937,
+    "predict_Loading_port_f1": 0.9066084107045331,
+    "predict_Loading_port_number": 899,
+    "predict_Loading_port_precision": 0.8905579399141631,
+    "predict_Loading_port_recall": 0.9232480533926585,
+    "predict_Shipment_terms_f1": 0.6779661016949152,
+    "predict_Shipment_terms_number": 118,
+    "predict_Shipment_terms_precision": 0.6779661016949152,
+    "predict_Shipment_terms_recall": 0.6779661016949152,
+    "predict_Vessel_Requirements_f1": 0.4357541899441341,
+    "predict_Vessel_Requirements_number": 76,
+    "predict_Vessel_Requirements_precision": 0.3786407766990291,
+    "predict_Vessel_Requirements_recall": 0.5131578947368421,
+    "predict_loss": 0.14810970425605774,
+    "predict_overall_accuracy": 0.9687605197603177,
+    "predict_overall_f1": 0.8309832675314909,
+    "predict_overall_precision": 0.8040749499727123,
+    "predict_overall_recall": 0.859754911495818,
+    "predict_runtime": 19.1276,
+    "predict_samples_per_second": 24.938,
+    "predict_steps_per_second": 3.137,
+    "train_loss": 0.0958036256437542,
+    "train_runtime": 2372.2017,
+    "train_samples": 1905,
+    "train_samples_per_second": 8.031,
+    "train_steps_per_second": 0.502
+}

config.json

@@ -0,0 +1,94 @@
+{
+  "_name_or_path": "microsoft/deberta-v3-large",
+  "architectures": [
+    "DebertaV2ForTokenClassification"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "finetuning_task": "ner",
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 1024,
+  "id2label": {
+    "0": "B-Cargo_Dimension",
+    "1": "B-Cargo_Quantity",
+    "2": "B-Cargo_Requirements",
+    "3": "B-Cargo_Stowage_Factor",
+    "4": "B-Cargo_Type",
+    "5": "B-Cargo_Weigh_Volume",
+    "6": "B-Commission_rate",
+    "7": "B-Discharging_port",
+    "8": "B-Laycan_date",
+    "9": "B-Loading_Discharging_terms",
+    "10": "B-Loading_port",
+    "11": "B-Shipment_terms",
+    "12": "B-Vessel_Requirements",
+    "13": "I-Cargo_Dimension",
+    "14": "I-Cargo_Quantity",
+    "15": "I-Cargo_Requirements",
+    "16": "I-Cargo_Stowage_Factor",
+    "17": "I-Cargo_Type",
+    "18": "I-Cargo_Weigh_Volume",
+    "19": "I-Commission_rate",
+    "20": "I-Discharging_port",
+    "21": "I-Laycan_date",
+    "22": "I-Loading_Discharging_terms",
+    "23": "I-Loading_port",
+    "24": "I-Shipment_terms",
+    "25": "I-Vessel_Requirements",
+    "26": "O"
+  },
+  "initializer_range": 0.02,
+  "intermediate_size": 4096,
+  "label2id": {
+    "B-Cargo_Dimension": 0,
+    "B-Cargo_Quantity": 1,
+    "B-Cargo_Requirements": 2,
+    "B-Cargo_Stowage_Factor": 3,
+    "B-Cargo_Type": 4,
+    "B-Cargo_Weigh_Volume": 5,
+    "B-Commission_rate": 6,
+    "B-Discharging_port": 7,
+    "B-Laycan_date": 8,
+    "B-Loading_Discharging_terms": 9,
+    "B-Loading_port": 10,
+    "B-Shipment_terms": 11,
+    "B-Vessel_Requirements": 12,
+    "I-Cargo_Dimension": 13,
+    "I-Cargo_Quantity": 14,
+    "I-Cargo_Requirements": 15,
+    "I-Cargo_Stowage_Factor": 16,
+    "I-Cargo_Type": 17,
+    "I-Cargo_Weigh_Volume": 18,
+    "I-Commission_rate": 19,
+    "I-Discharging_port": 20,
+    "I-Laycan_date": 21,
+    "I-Loading_Discharging_terms": 22,
+    "I-Loading_port": 23,
+    "I-Shipment_terms": 24,
+    "I-Vessel_Requirements": 25,
+    "O": 26
+  },
+  "layer_norm_eps": 1e-07,
+  "max_position_embeddings": 512,
+  "max_relative_positions": -1,
+  "model_type": "deberta-v2",
+  "norm_rel_ebd": "layer_norm",
+  "num_attention_heads": 16,
+  "num_hidden_layers": 24,
+  "pad_token_id": 0,
+  "pooler_dropout": 0,
+  "pooler_hidden_act": "gelu",
+  "pooler_hidden_size": 1024,
+  "pos_att_type": [
+    "p2c",
+    "c2p"
+  ],
+  "position_biased_input": false,
+  "position_buckets": 256,
+  "relative_attention": true,
+  "share_att_key": true,
+  "torch_dtype": "float32",
+  "transformers_version": "4.36.0.dev0",
+  "type_vocab_size": 0,
+  "vocab_size": 128100
+}

eval_results.json

@@ -0,0 +1,64 @@
+{
+    "epoch": 9.96,
+    "eval_Cargo_Dimension_f1": 0.8437499999999999,
+    "eval_Cargo_Dimension_number": 114,
+    "eval_Cargo_Dimension_precision": 0.7605633802816901,
+    "eval_Cargo_Dimension_recall": 0.9473684210526315,
+    "eval_Cargo_Quantity_f1": 0.8486238532110092,
+    "eval_Cargo_Quantity_number": 207,
+    "eval_Cargo_Quantity_precision": 0.8078602620087336,
+    "eval_Cargo_Quantity_recall": 0.893719806763285,
+    "eval_Cargo_Requirements_f1": 0.5641025641025641,
+    "eval_Cargo_Requirements_number": 202,
+    "eval_Cargo_Requirements_precision": 0.49624060150375937,
+    "eval_Cargo_Requirements_recall": 0.6534653465346535,
+    "eval_Cargo_Stowage_Factor_f1": 0.829268292682927,
+    "eval_Cargo_Stowage_Factor_number": 122,
+    "eval_Cargo_Stowage_Factor_precision": 0.8225806451612904,
+    "eval_Cargo_Stowage_Factor_recall": 0.8360655737704918,
+    "eval_Cargo_Type_f1": 0.8031383737517832,
+    "eval_Cargo_Type_number": 688,
+    "eval_Cargo_Type_precision": 0.788515406162465,
+    "eval_Cargo_Type_recall": 0.8183139534883721,
+    "eval_Cargo_Weigh_Volume_f1": 0.8770270270270271,
+    "eval_Cargo_Weigh_Volume_number": 719,
+    "eval_Cargo_Weigh_Volume_precision": 0.8528252299605782,
+    "eval_Cargo_Weigh_Volume_recall": 0.9026425591098748,
+    "eval_Commission_rate_f1": 0.8196248196248196,
+    "eval_Commission_rate_number": 336,
+    "eval_Commission_rate_precision": 0.7955182072829131,
+    "eval_Commission_rate_recall": 0.8452380952380952,
+    "eval_Discharging_port_f1": 0.8857808857808858,
+    "eval_Discharging_port_number": 843,
+    "eval_Discharging_port_precision": 0.870561282932417,
+    "eval_Discharging_port_recall": 0.9015421115065243,
+    "eval_Laycan_date_f1": 0.8478900883218843,
+    "eval_Laycan_date_number": 496,
+    "eval_Laycan_date_precision": 0.8260038240917782,
+    "eval_Laycan_date_recall": 0.8709677419354839,
+    "eval_Loading_Discharging_terms_f1": 0.757396449704142,
+    "eval_Loading_Discharging_terms_number": 321,
+    "eval_Loading_Discharging_terms_precision": 0.7211267605633803,
+    "eval_Loading_Discharging_terms_recall": 0.7975077881619937,
+    "eval_Loading_port_f1": 0.9066084107045331,
+    "eval_Loading_port_number": 899,
+    "eval_Loading_port_precision": 0.8905579399141631,
+    "eval_Loading_port_recall": 0.9232480533926585,
+    "eval_Shipment_terms_f1": 0.6779661016949152,
+    "eval_Shipment_terms_number": 118,
+    "eval_Shipment_terms_precision": 0.6779661016949152,
+    "eval_Shipment_terms_recall": 0.6779661016949152,
+    "eval_Vessel_Requirements_f1": 0.4357541899441341,
+    "eval_Vessel_Requirements_number": 76,
+    "eval_Vessel_Requirements_precision": 0.3786407766990291,
+    "eval_Vessel_Requirements_recall": 0.5131578947368421,
+    "eval_loss": 0.14810970425605774,
+    "eval_overall_accuracy": 0.9687605197603177,
+    "eval_overall_f1": 0.8309832675314909,
+    "eval_overall_precision": 0.8040749499727123,
+    "eval_overall_recall": 0.859754911495818,
+    "eval_runtime": 19.0868,
+    "eval_samples": 477,
+    "eval_samples_per_second": 24.991,
+    "eval_steps_per_second": 3.144
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a04272de73714b1e6deb226c87e713f1dd2eee1456c13dc1ca5ded093e1c25ea
+size 1736208372

predict_results.json

@@ -0,0 +1,62 @@
+{
+    "predict_Cargo_Dimension_f1": 0.8437499999999999,
+    "predict_Cargo_Dimension_number": 114,
+    "predict_Cargo_Dimension_precision": 0.7605633802816901,
+    "predict_Cargo_Dimension_recall": 0.9473684210526315,
+    "predict_Cargo_Quantity_f1": 0.8486238532110092,
+    "predict_Cargo_Quantity_number": 207,
+    "predict_Cargo_Quantity_precision": 0.8078602620087336,
+    "predict_Cargo_Quantity_recall": 0.893719806763285,
+    "predict_Cargo_Requirements_f1": 0.5641025641025641,
+    "predict_Cargo_Requirements_number": 202,
+    "predict_Cargo_Requirements_precision": 0.49624060150375937,
+    "predict_Cargo_Requirements_recall": 0.6534653465346535,
+    "predict_Cargo_Stowage_Factor_f1": 0.829268292682927,
+    "predict_Cargo_Stowage_Factor_number": 122,
+    "predict_Cargo_Stowage_Factor_precision": 0.8225806451612904,
+    "predict_Cargo_Stowage_Factor_recall": 0.8360655737704918,
+    "predict_Cargo_Type_f1": 0.8031383737517832,
+    "predict_Cargo_Type_number": 688,
+    "predict_Cargo_Type_precision": 0.788515406162465,
+    "predict_Cargo_Type_recall": 0.8183139534883721,
+    "predict_Cargo_Weigh_Volume_f1": 0.8770270270270271,
+    "predict_Cargo_Weigh_Volume_number": 719,
+    "predict_Cargo_Weigh_Volume_precision": 0.8528252299605782,
+    "predict_Cargo_Weigh_Volume_recall": 0.9026425591098748,
+    "predict_Commission_rate_f1": 0.8196248196248196,
+    "predict_Commission_rate_number": 336,
+    "predict_Commission_rate_precision": 0.7955182072829131,
+    "predict_Commission_rate_recall": 0.8452380952380952,
+    "predict_Discharging_port_f1": 0.8857808857808858,
+    "predict_Discharging_port_number": 843,
+    "predict_Discharging_port_precision": 0.870561282932417,
+    "predict_Discharging_port_recall": 0.9015421115065243,
+    "predict_Laycan_date_f1": 0.8478900883218843,
+    "predict_Laycan_date_number": 496,
+    "predict_Laycan_date_precision": 0.8260038240917782,
+    "predict_Laycan_date_recall": 0.8709677419354839,
+    "predict_Loading_Discharging_terms_f1": 0.757396449704142,
+    "predict_Loading_Discharging_terms_number": 321,
+    "predict_Loading_Discharging_terms_precision": 0.7211267605633803,
+    "predict_Loading_Discharging_terms_recall": 0.7975077881619937,
+    "predict_Loading_port_f1": 0.9066084107045331,
+    "predict_Loading_port_number": 899,
+    "predict_Loading_port_precision": 0.8905579399141631,
+    "predict_Loading_port_recall": 0.9232480533926585,
+    "predict_Shipment_terms_f1": 0.6779661016949152,
+    "predict_Shipment_terms_number": 118,
+    "predict_Shipment_terms_precision": 0.6779661016949152,
+    "predict_Shipment_terms_recall": 0.6779661016949152,
+    "predict_Vessel_Requirements_f1": 0.4357541899441341,
+    "predict_Vessel_Requirements_number": 76,
+    "predict_Vessel_Requirements_precision": 0.3786407766990291,
+    "predict_Vessel_Requirements_recall": 0.5131578947368421,
+    "predict_loss": 0.14810970425605774,
+    "predict_overall_accuracy": 0.9687605197603177,
+    "predict_overall_f1": 0.8309832675314909,
+    "predict_overall_precision": 0.8040749499727123,
+    "predict_overall_recall": 0.859754911495818,
+    "predict_runtime": 19.1276,
+    "predict_samples_per_second": 24.938,
+    "predict_steps_per_second": 3.137
+}

runs/Dec06_06-57-47_ntq/events.out.tfevents.1701845877.ntq.2445174.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1b9b8aa9fafca78e843d80d2a5d035b86050965b4f6fa86213050484a1ca77fd
+size 47995

runs/Dec06_06-57-47_ntq/events.out.tfevents.1701848269.ntq.2445174.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6ac5d2606dfcb6adb77fe9de5316fdfe5e24c43b36d7aab4acbf819b244ccc8f
+size 4059

special_tokens_map.json

@@ -0,0 +1,15 @@
+{
+  "bos_token": "[CLS]",
+  "cls_token": "[CLS]",
+  "eos_token": "[SEP]",
+  "mask_token": "[MASK]",
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}

spm.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c679fbf93643d19aab7ee10c0b99e460bdbc02fedf34b92b05af343b4af586fd
+size 2464616

tokenizer_config.json

@@ -0,0 +1,58 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "128000": {
+      "content": "[MASK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "[CLS]",
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "[CLS]",
+  "do_lower_case": false,
+  "eos_token": "[SEP]",
+  "mask_token": "[MASK]",
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "sp_model_kwargs": {},
+  "split_by_punct": false,
+  "tokenizer_class": "DebertaV2Tokenizer",
+  "unk_token": "[UNK]",
+  "vocab_type": "spm"
+}

train_results.json

@@ -0,0 +1,8 @@
+{
+    "epoch": 9.96,
+    "train_loss": 0.0958036256437542,
+    "train_runtime": 2372.2017,
+    "train_samples": 1905,
+    "train_samples_per_second": 8.031,
+    "train_steps_per_second": 0.502
+}

trainer_state.json

@@ -0,0 +1,735 @@
+{
+  "best_metric": 0.8309832675314909,
+  "best_model_checkpoint": "/hdd-6tb/llm_model/BBC/bbc-ner-deberta-large_baseline2_dims/checkpoint-1190",
+  "epoch": 9.9581589958159,
+  "eval_steps": 500,
+  "global_step": 1190,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.84,
+      "learning_rate": 4.579831932773109e-05,
+      "loss": 0.4476,
+      "step": 100
+    },
+    {
+      "epoch": 1.0,
+      "eval_Cargo_Dimension_f1": 0.7089552238805971,
+      "eval_Cargo_Dimension_number": 114,
+      "eval_Cargo_Dimension_precision": 0.6168831168831169,
+      "eval_Cargo_Dimension_recall": 0.8333333333333334,
+      "eval_Cargo_Quantity_f1": 0.7809110629067244,
+      "eval_Cargo_Quantity_number": 207,
+      "eval_Cargo_Quantity_precision": 0.7086614173228346,
+      "eval_Cargo_Quantity_recall": 0.8695652173913043,
+      "eval_Cargo_Requirements_f1": 0.3524590163934426,
+      "eval_Cargo_Requirements_number": 202,
+      "eval_Cargo_Requirements_precision": 0.3006993006993007,
+      "eval_Cargo_Requirements_recall": 0.42574257425742573,
+      "eval_Cargo_Stowage_Factor_f1": 0.6888888888888889,
+      "eval_Cargo_Stowage_Factor_number": 122,
+      "eval_Cargo_Stowage_Factor_precision": 0.6283783783783784,
+      "eval_Cargo_Stowage_Factor_recall": 0.7622950819672131,
+      "eval_Cargo_Type_f1": 0.6391752577319587,
+      "eval_Cargo_Type_number": 688,
+      "eval_Cargo_Type_precision": 0.6477611940298508,
+      "eval_Cargo_Type_recall": 0.6308139534883721,
+      "eval_Cargo_Weigh_Volume_f1": 0.7533632286995515,
+      "eval_Cargo_Weigh_Volume_number": 719,
+      "eval_Cargo_Weigh_Volume_precision": 0.6983372921615202,
+      "eval_Cargo_Weigh_Volume_recall": 0.8178025034770514,
+      "eval_Commission_rate_f1": 0.7363896848137536,
+      "eval_Commission_rate_number": 336,
+      "eval_Commission_rate_precision": 0.7099447513812155,
+      "eval_Commission_rate_recall": 0.7648809523809523,
+      "eval_Discharging_port_f1": 0.7879440258342304,
+      "eval_Discharging_port_number": 843,
+      "eval_Discharging_port_precision": 0.7211822660098522,
+      "eval_Discharging_port_recall": 0.8683274021352313,
+      "eval_Laycan_date_f1": 0.7854406130268201,
+      "eval_Laycan_date_number": 496,
+      "eval_Laycan_date_precision": 0.7481751824817519,
+      "eval_Laycan_date_recall": 0.8266129032258065,
+      "eval_Loading_Discharging_terms_f1": 0.6153846153846154,
+      "eval_Loading_Discharging_terms_number": 321,
+      "eval_Loading_Discharging_terms_precision": 0.5669291338582677,
+      "eval_Loading_Discharging_terms_recall": 0.6728971962616822,
+      "eval_Loading_port_f1": 0.8419901585565883,
+      "eval_Loading_port_number": 899,
+      "eval_Loading_port_precision": 0.8279569892473119,
+      "eval_Loading_port_recall": 0.8565072302558399,
+      "eval_Shipment_terms_f1": 0.5673076923076924,
+      "eval_Shipment_terms_number": 118,
+      "eval_Shipment_terms_precision": 0.6555555555555556,
+      "eval_Shipment_terms_recall": 0.5,
+      "eval_Vessel_Requirements_f1": 0.06578947368421052,
+      "eval_Vessel_Requirements_number": 76,
+      "eval_Vessel_Requirements_precision": 0.06578947368421052,
+      "eval_Vessel_Requirements_recall": 0.06578947368421052,
+      "eval_loss": 0.15225446224212646,
+      "eval_overall_accuracy": 0.9580940839272489,
+      "eval_overall_f1": 0.7203817564467285,
+      "eval_overall_precision": 0.6818971507991661,
+      "eval_overall_recall": 0.7634701419957207,
+      "eval_runtime": 19.1596,
+      "eval_samples_per_second": 24.896,
+      "eval_steps_per_second": 3.132,
+      "step": 119
+    },
+    {
+      "epoch": 1.67,
+      "learning_rate": 4.159663865546219e-05,
+      "loss": 0.132,
+      "step": 200
+    },
+    {
+      "epoch": 2.0,
+      "eval_Cargo_Dimension_f1": 0.7415730337078651,
+      "eval_Cargo_Dimension_number": 114,
+      "eval_Cargo_Dimension_precision": 0.6470588235294118,
+      "eval_Cargo_Dimension_recall": 0.868421052631579,
+      "eval_Cargo_Quantity_f1": 0.8151260504201681,
+      "eval_Cargo_Quantity_number": 207,
+      "eval_Cargo_Quantity_precision": 0.7211895910780669,
+      "eval_Cargo_Quantity_recall": 0.9371980676328503,
+      "eval_Cargo_Requirements_f1": 0.34816247582205023,
+      "eval_Cargo_Requirements_number": 202,
+      "eval_Cargo_Requirements_precision": 0.2857142857142857,
+      "eval_Cargo_Requirements_recall": 0.44554455445544555,
+      "eval_Cargo_Stowage_Factor_f1": 0.7669172932330828,
+      "eval_Cargo_Stowage_Factor_number": 122,
+      "eval_Cargo_Stowage_Factor_precision": 0.7083333333333334,
+      "eval_Cargo_Stowage_Factor_recall": 0.8360655737704918,
+      "eval_Cargo_Type_f1": 0.7332474226804124,
+      "eval_Cargo_Type_number": 688,
+      "eval_Cargo_Type_precision": 0.6585648148148148,
+      "eval_Cargo_Type_recall": 0.8270348837209303,
+      "eval_Cargo_Weigh_Volume_f1": 0.7955251709136109,
+      "eval_Cargo_Weigh_Volume_number": 719,
+      "eval_Cargo_Weigh_Volume_precision": 0.7191011235955056,
+      "eval_Cargo_Weigh_Volume_recall": 0.8901251738525731,
+      "eval_Commission_rate_f1": 0.8188302425106989,
+      "eval_Commission_rate_number": 336,
+      "eval_Commission_rate_precision": 0.7863013698630137,
+      "eval_Commission_rate_recall": 0.8541666666666666,
+      "eval_Discharging_port_f1": 0.8240437158469945,
+      "eval_Discharging_port_number": 843,
+      "eval_Discharging_port_precision": 0.7639311043566362,
+      "eval_Discharging_port_recall": 0.8944246737841044,
+      "eval_Laycan_date_f1": 0.7932960893854748,
+      "eval_Laycan_date_number": 496,
+      "eval_Laycan_date_precision": 0.7370242214532872,
+      "eval_Laycan_date_recall": 0.8588709677419355,
+      "eval_Loading_Discharging_terms_f1": 0.6434108527131784,
+      "eval_Loading_Discharging_terms_number": 321,
+      "eval_Loading_Discharging_terms_precision": 0.5496688741721855,
+      "eval_Loading_Discharging_terms_recall": 0.7757009345794392,
+      "eval_Loading_port_f1": 0.8728260869565216,
+      "eval_Loading_port_number": 899,
+      "eval_Loading_port_precision": 0.8533475026567482,
+      "eval_Loading_port_recall": 0.8932146829810901,
+      "eval_Shipment_terms_f1": 0.5877551020408163,
+      "eval_Shipment_terms_number": 118,
+      "eval_Shipment_terms_precision": 0.5669291338582677,
+      "eval_Shipment_terms_recall": 0.6101694915254238,
+      "eval_Vessel_Requirements_f1": 0.26865671641791045,
+      "eval_Vessel_Requirements_number": 76,
+      "eval_Vessel_Requirements_precision": 0.216,
+      "eval_Vessel_Requirements_recall": 0.35526315789473684,
+      "eval_loss": 0.143841952085495,
+      "eval_overall_accuracy": 0.9579305767954526,
+      "eval_overall_f1": 0.7596899224806202,
+      "eval_overall_precision": 0.6942521333118661,
+      "eval_overall_recall": 0.8387473254230694,
+      "eval_runtime": 19.1736,
+      "eval_samples_per_second": 24.878,
+      "eval_steps_per_second": 3.129,
+      "step": 239
+    },
+    {
+      "epoch": 2.51,
+      "learning_rate": 3.739495798319328e-05,
+      "loss": 0.1022,
+      "step": 300
+    },
+    {
+      "epoch": 3.0,
+      "eval_Cargo_Dimension_f1": 0.8240000000000001,
+      "eval_Cargo_Dimension_number": 114,
+      "eval_Cargo_Dimension_precision": 0.7573529411764706,
+      "eval_Cargo_Dimension_recall": 0.9035087719298246,
+      "eval_Cargo_Quantity_f1": 0.8512585812356979,
+      "eval_Cargo_Quantity_number": 207,
+      "eval_Cargo_Quantity_precision": 0.808695652173913,
+      "eval_Cargo_Quantity_recall": 0.8985507246376812,
+      "eval_Cargo_Requirements_f1": 0.4683544303797469,
+      "eval_Cargo_Requirements_number": 202,
+      "eval_Cargo_Requirements_precision": 0.40808823529411764,
+      "eval_Cargo_Requirements_recall": 0.5495049504950495,
+      "eval_Cargo_Stowage_Factor_f1": 0.7906976744186046,
+      "eval_Cargo_Stowage_Factor_number": 122,
+      "eval_Cargo_Stowage_Factor_precision": 0.75,
+      "eval_Cargo_Stowage_Factor_recall": 0.8360655737704918,
+      "eval_Cargo_Type_f1": 0.7697594501718213,
+      "eval_Cargo_Type_number": 688,
+      "eval_Cargo_Type_precision": 0.7301173402868318,
+      "eval_Cargo_Type_recall": 0.813953488372093,
+      "eval_Cargo_Weigh_Volume_f1": 0.8416107382550335,
+      "eval_Cargo_Weigh_Volume_number": 719,
+      "eval_Cargo_Weigh_Volume_precision": 0.8132295719844358,
+      "eval_Cargo_Weigh_Volume_recall": 0.8720445062586927,
+      "eval_Commission_rate_f1": 0.8225108225108225,
+      "eval_Commission_rate_number": 336,
+      "eval_Commission_rate_precision": 0.7983193277310925,
+      "eval_Commission_rate_recall": 0.8482142857142857,
+      "eval_Discharging_port_f1": 0.8577827547592385,
+      "eval_Discharging_port_number": 843,
+      "eval_Discharging_port_precision": 0.8123011664899258,
+      "eval_Discharging_port_recall": 0.9086595492289442,
+      "eval_Laycan_date_f1": 0.8295019157088122,
+      "eval_Laycan_date_number": 496,
+      "eval_Laycan_date_precision": 0.7901459854014599,
+      "eval_Laycan_date_recall": 0.8729838709677419,
+      "eval_Loading_Discharging_terms_f1": 0.7699386503067484,
+      "eval_Loading_Discharging_terms_number": 321,
+      "eval_Loading_Discharging_terms_precision": 0.7583081570996979,
+      "eval_Loading_Discharging_terms_recall": 0.7819314641744548,
+      "eval_Loading_port_f1": 0.9002169197396963,
+      "eval_Loading_port_number": 899,
+      "eval_Loading_port_precision": 0.8783068783068783,
+      "eval_Loading_port_recall": 0.9232480533926585,
+      "eval_Shipment_terms_f1": 0.7117117117117118,
+      "eval_Shipment_terms_number": 118,
+      "eval_Shipment_terms_precision": 0.7596153846153846,
+      "eval_Shipment_terms_recall": 0.6694915254237288,
+      "eval_Vessel_Requirements_f1": 0.40449438202247195,
+      "eval_Vessel_Requirements_number": 76,
+      "eval_Vessel_Requirements_precision": 0.35294117647058826,
+      "eval_Vessel_Requirements_recall": 0.47368421052631576,
+      "eval_loss": 0.12171842902898788,
+      "eval_overall_accuracy": 0.9676736782372007,
+      "eval_overall_f1": 0.8103496244087915,
+      "eval_overall_precision": 0.7743707904998227,
+      "eval_overall_recall": 0.84983466251702,
+      "eval_runtime": 19.1324,
+      "eval_samples_per_second": 24.932,
+      "eval_steps_per_second": 3.136,
+      "step": 358
+    },
+    {
+      "epoch": 3.35,
+      "learning_rate": 3.319327731092437e-05,
+      "loss": 0.0802,
+      "step": 400
+    },
+    {
+      "epoch": 4.0,
+      "eval_Cargo_Dimension_f1": 0.8392156862745098,
+      "eval_Cargo_Dimension_number": 114,
+      "eval_Cargo_Dimension_precision": 0.7588652482269503,
+      "eval_Cargo_Dimension_recall": 0.9385964912280702,
+      "eval_Cargo_Quantity_f1": 0.8452655889145497,
+      "eval_Cargo_Quantity_number": 207,
+      "eval_Cargo_Quantity_precision": 0.8097345132743363,
+      "eval_Cargo_Quantity_recall": 0.8840579710144928,
+      "eval_Cargo_Requirements_f1": 0.5182012847965739,
+      "eval_Cargo_Requirements_number": 202,
+      "eval_Cargo_Requirements_precision": 0.45660377358490567,
+      "eval_Cargo_Requirements_recall": 0.599009900990099,
+      "eval_Cargo_Stowage_Factor_f1": 0.8312757201646092,
+      "eval_Cargo_Stowage_Factor_number": 122,
+      "eval_Cargo_Stowage_Factor_precision": 0.8347107438016529,
+      "eval_Cargo_Stowage_Factor_recall": 0.8278688524590164,
+      "eval_Cargo_Type_f1": 0.7721335268505078,
+      "eval_Cargo_Type_number": 688,
+      "eval_Cargo_Type_precision": 0.7710144927536232,
+      "eval_Cargo_Type_recall": 0.7732558139534884,
+      "eval_Cargo_Weigh_Volume_f1": 0.8397350993377483,
+      "eval_Cargo_Weigh_Volume_number": 719,
+      "eval_Cargo_Weigh_Volume_precision": 0.8015170670037927,
+      "eval_Cargo_Weigh_Volume_recall": 0.8817802503477051,
+      "eval_Commission_rate_f1": 0.8311306901615272,
+      "eval_Commission_rate_number": 336,
+      "eval_Commission_rate_precision": 0.8202898550724638,
+      "eval_Commission_rate_recall": 0.8422619047619048,
+      "eval_Discharging_port_f1": 0.8767123287671232,
+      "eval_Discharging_port_number": 843,
+      "eval_Discharging_port_precision": 0.8448844884488449,
+      "eval_Discharging_port_recall": 0.9110320284697508,
+      "eval_Laycan_date_f1": 0.8540856031128404,
+      "eval_Laycan_date_number": 496,
+      "eval_Laycan_date_precision": 0.825187969924812,
+      "eval_Laycan_date_recall": 0.8850806451612904,
+      "eval_Loading_Discharging_terms_f1": 0.7366818873668188,
+      "eval_Loading_Discharging_terms_number": 321,
+      "eval_Loading_Discharging_terms_precision": 0.7202380952380952,
+      "eval_Loading_Discharging_terms_recall": 0.7538940809968847,
+      "eval_Loading_port_f1": 0.89247311827957,
+      "eval_Loading_port_number": 899,
+      "eval_Loading_port_precision": 0.8636836628511967,
+      "eval_Loading_port_recall": 0.9232480533926585,
+      "eval_Shipment_terms_f1": 0.6936936936936937,
+      "eval_Shipment_terms_number": 118,
+      "eval_Shipment_terms_precision": 0.7403846153846154,
+      "eval_Shipment_terms_recall": 0.652542372881356,
+      "eval_Vessel_Requirements_f1": 0.44155844155844154,
+      "eval_Vessel_Requirements_number": 76,
+      "eval_Vessel_Requirements_precision": 0.4358974358974359,
+      "eval_Vessel_Requirements_recall": 0.4473684210526316,
+      "eval_loss": 0.1290501207113266,
+      "eval_overall_accuracy": 0.9682988525646574,
+      "eval_overall_f1": 0.8178571428571428,
+      "eval_overall_precision": 0.7912347699581742,
+      "eval_overall_recall": 0.846333398171562,
+      "eval_runtime": 19.1551,
+      "eval_samples_per_second": 24.902,
+      "eval_steps_per_second": 3.132,
+      "step": 478
+    },
+    {
+      "epoch": 4.18,
+      "learning_rate": 2.8991596638655467e-05,
+      "loss": 0.0733,
+      "step": 500
+    },
+    {
+      "epoch": 5.0,
+      "eval_Cargo_Dimension_f1": 0.8275862068965517,
+      "eval_Cargo_Dimension_number": 114,
+      "eval_Cargo_Dimension_precision": 0.7346938775510204,
+      "eval_Cargo_Dimension_recall": 0.9473684210526315,
+      "eval_Cargo_Quantity_f1": 0.8513513513513514,
+      "eval_Cargo_Quantity_number": 207,
+      "eval_Cargo_Quantity_precision": 0.7974683544303798,
+      "eval_Cargo_Quantity_recall": 0.9130434782608695,
+      "eval_Cargo_Requirements_f1": 0.5061224489795919,
+      "eval_Cargo_Requirements_number": 202,
+      "eval_Cargo_Requirements_precision": 0.4305555555555556,
+      "eval_Cargo_Requirements_recall": 0.6138613861386139,
+      "eval_Cargo_Stowage_Factor_f1": 0.8286852589641434,
+      "eval_Cargo_Stowage_Factor_number": 122,
+      "eval_Cargo_Stowage_Factor_precision": 0.8062015503875969,
+      "eval_Cargo_Stowage_Factor_recall": 0.8524590163934426,
+      "eval_Cargo_Type_f1": 0.785464709993012,
+      "eval_Cargo_Type_number": 688,
+      "eval_Cargo_Type_precision": 0.756393001345895,
+      "eval_Cargo_Type_recall": 0.8168604651162791,
+      "eval_Cargo_Weigh_Volume_f1": 0.8504983388704319,
+      "eval_Cargo_Weigh_Volume_number": 719,
+      "eval_Cargo_Weigh_Volume_precision": 0.8142493638676844,
+      "eval_Cargo_Weigh_Volume_recall": 0.8901251738525731,
+      "eval_Commission_rate_f1": 0.8316251830161054,
+      "eval_Commission_rate_number": 336,
+      "eval_Commission_rate_precision": 0.8184438040345822,
+      "eval_Commission_rate_recall": 0.8452380952380952,
+      "eval_Discharging_port_f1": 0.8903150525087514,
+      "eval_Discharging_port_number": 843,
+      "eval_Discharging_port_precision": 0.8760045924225028,
+      "eval_Discharging_port_recall": 0.9051008303677343,
+      "eval_Laycan_date_f1": 0.8474246841593781,
+      "eval_Laycan_date_number": 496,
+      "eval_Laycan_date_precision": 0.8180112570356473,
+      "eval_Laycan_date_recall": 0.8790322580645161,
+      "eval_Loading_Discharging_terms_f1": 0.7680945347119645,
+      "eval_Loading_Discharging_terms_number": 321,
+      "eval_Loading_Discharging_terms_precision": 0.7303370786516854,
+      "eval_Loading_Discharging_terms_recall": 0.8099688473520249,
+      "eval_Loading_port_f1": 0.9025309639203016,
+      "eval_Loading_port_number": 899,
+      "eval_Loading_port_precision": 0.8747390396659708,
+      "eval_Loading_port_recall": 0.932146829810901,
+      "eval_Shipment_terms_f1": 0.6532258064516129,
+      "eval_Shipment_terms_number": 118,
+      "eval_Shipment_terms_precision": 0.6230769230769231,
+      "eval_Shipment_terms_recall": 0.6864406779661016,
+      "eval_Vessel_Requirements_f1": 0.37125748502994016,
+      "eval_Vessel_Requirements_number": 76,
+      "eval_Vessel_Requirements_precision": 0.34065934065934067,
+      "eval_Vessel_Requirements_recall": 0.40789473684210525,
+      "eval_loss": 0.12692071497440338,
+      "eval_overall_accuracy": 0.9681161092997086,
+      "eval_overall_f1": 0.8217904620247282,
+      "eval_overall_precision": 0.7870370370370371,
+      "eval_overall_recall": 0.859754911495818,
+      "eval_runtime": 19.1476,
+      "eval_samples_per_second": 24.912,
+      "eval_steps_per_second": 3.134,
+      "step": 597
+    },
+    {
+      "epoch": 5.02,
+      "learning_rate": 2.4789915966386556e-05,
+      "loss": 0.0608,
+      "step": 600
+    },
+    {
+      "epoch": 5.86,
+      "learning_rate": 2.058823529411765e-05,
+      "loss": 0.0541,
+      "step": 700
+    },
+    {
+      "epoch": 6.0,
+      "eval_Cargo_Dimension_f1": 0.8262548262548263,
+      "eval_Cargo_Dimension_number": 114,
+      "eval_Cargo_Dimension_precision": 0.7379310344827587,
+      "eval_Cargo_Dimension_recall": 0.9385964912280702,
+      "eval_Cargo_Quantity_f1": 0.8449438202247191,
+      "eval_Cargo_Quantity_number": 207,
+      "eval_Cargo_Quantity_precision": 0.7899159663865546,
+      "eval_Cargo_Quantity_recall": 0.9082125603864735,
+      "eval_Cargo_Requirements_f1": 0.5111561866125761,
+      "eval_Cargo_Requirements_number": 202,
+      "eval_Cargo_Requirements_precision": 0.4329896907216495,
+      "eval_Cargo_Requirements_recall": 0.6237623762376238,
+      "eval_Cargo_Stowage_Factor_f1": 0.8225806451612904,
+      "eval_Cargo_Stowage_Factor_number": 122,
+      "eval_Cargo_Stowage_Factor_precision": 0.8095238095238095,
+      "eval_Cargo_Stowage_Factor_recall": 0.8360655737704918,
+      "eval_Cargo_Type_f1": 0.7923997185080929,
+      "eval_Cargo_Type_number": 688,
+      "eval_Cargo_Type_precision": 0.7680763983628922,
+      "eval_Cargo_Type_recall": 0.8183139534883721,
+      "eval_Cargo_Weigh_Volume_f1": 0.8392156862745098,
+      "eval_Cargo_Weigh_Volume_number": 719,
+      "eval_Cargo_Weigh_Volume_precision": 0.7916152897657214,
+      "eval_Cargo_Weigh_Volume_recall": 0.8929068150208623,
+      "eval_Commission_rate_f1": 0.8372093023255814,
+      "eval_Commission_rate_number": 336,
+      "eval_Commission_rate_precision": 0.8181818181818182,
+      "eval_Commission_rate_recall": 0.8571428571428571,
+      "eval_Discharging_port_f1": 0.8772935779816513,
+      "eval_Discharging_port_number": 843,
+      "eval_Discharging_port_precision": 0.8490566037735849,
+      "eval_Discharging_port_recall": 0.9074733096085409,
+      "eval_Laycan_date_f1": 0.8360814742967991,
+      "eval_Laycan_date_number": 496,
+      "eval_Laycan_date_precision": 0.805607476635514,
+      "eval_Laycan_date_recall": 0.8689516129032258,
+      "eval_Loading_Discharging_terms_f1": 0.7390029325513195,
+      "eval_Loading_Discharging_terms_number": 321,
+      "eval_Loading_Discharging_terms_precision": 0.6980609418282548,
+      "eval_Loading_Discharging_terms_recall": 0.7850467289719626,
+      "eval_Loading_port_f1": 0.9099730458221025,
+      "eval_Loading_port_number": 899,
+      "eval_Loading_port_precision": 0.8828451882845189,
+      "eval_Loading_port_recall": 0.9388209121245829,
+      "eval_Shipment_terms_f1": 0.6839826839826839,
+      "eval_Shipment_terms_number": 118,
+      "eval_Shipment_terms_precision": 0.6991150442477876,
+      "eval_Shipment_terms_recall": 0.6694915254237288,
+      "eval_Vessel_Requirements_f1": 0.4318181818181818,
+      "eval_Vessel_Requirements_number": 76,
+      "eval_Vessel_Requirements_precision": 0.38,
+      "eval_Vessel_Requirements_recall": 0.5,
+      "eval_loss": 0.1299009621143341,
+      "eval_overall_accuracy": 0.9675871156380145,
+      "eval_overall_f1": 0.8192168841988337,
+      "eval_overall_precision": 0.7815259625574003,
+      "eval_overall_recall": 0.8607274849251119,
+      "eval_runtime": 19.1914,
+      "eval_samples_per_second": 24.855,
+      "eval_steps_per_second": 3.126,
+      "step": 717
+    },
+    {
+      "epoch": 6.69,
+      "learning_rate": 1.638655462184874e-05,
+      "loss": 0.0463,
+      "step": 800
+    },
+    {
+      "epoch": 7.0,
+      "eval_Cargo_Dimension_f1": 0.8379446640316206,
+      "eval_Cargo_Dimension_number": 114,
+      "eval_Cargo_Dimension_precision": 0.762589928057554,
+      "eval_Cargo_Dimension_recall": 0.9298245614035088,
+      "eval_Cargo_Quantity_f1": 0.853146853146853,
+      "eval_Cargo_Quantity_number": 207,
+      "eval_Cargo_Quantity_precision": 0.8243243243243243,
+      "eval_Cargo_Quantity_recall": 0.8840579710144928,
+      "eval_Cargo_Requirements_f1": 0.5324675324675324,
+      "eval_Cargo_Requirements_number": 202,
+      "eval_Cargo_Requirements_precision": 0.47307692307692306,
+      "eval_Cargo_Requirements_recall": 0.6089108910891089,
+      "eval_Cargo_Stowage_Factor_f1": 0.823529411764706,
+      "eval_Cargo_Stowage_Factor_number": 122,
+      "eval_Cargo_Stowage_Factor_precision": 0.7894736842105263,
+      "eval_Cargo_Stowage_Factor_recall": 0.860655737704918,
+      "eval_Cargo_Type_f1": 0.7869090909090908,
+      "eval_Cargo_Type_number": 688,
+      "eval_Cargo_Type_precision": 0.7874818049490538,
+      "eval_Cargo_Type_recall": 0.7863372093023255,
+      "eval_Cargo_Weigh_Volume_f1": 0.8625336927223719,
+      "eval_Cargo_Weigh_Volume_number": 719,
+      "eval_Cargo_Weigh_Volume_precision": 0.8366013071895425,
+      "eval_Cargo_Weigh_Volume_recall": 0.8901251738525731,
+      "eval_Commission_rate_f1": 0.8311688311688311,
+      "eval_Commission_rate_number": 336,
+      "eval_Commission_rate_precision": 0.8067226890756303,
+      "eval_Commission_rate_recall": 0.8571428571428571,
+      "eval_Discharging_port_f1": 0.8959810874704491,
+      "eval_Discharging_port_number": 843,
+      "eval_Discharging_port_precision": 0.8928150765606596,
+      "eval_Discharging_port_recall": 0.8991696322657177,
+      "eval_Laycan_date_f1": 0.8478260869565217,
+      "eval_Laycan_date_number": 496,
+      "eval_Laycan_date_precision": 0.8313953488372093,
+      "eval_Laycan_date_recall": 0.8649193548387096,
+      "eval_Loading_Discharging_terms_f1": 0.7835365853658536,
+      "eval_Loading_Discharging_terms_number": 321,
+      "eval_Loading_Discharging_terms_precision": 0.7671641791044777,
+      "eval_Loading_Discharging_terms_recall": 0.8006230529595015,
+      "eval_Loading_port_f1": 0.9077857537272225,
+      "eval_Loading_port_number": 899,
+      "eval_Loading_port_precision": 0.9013157894736842,
+      "eval_Loading_port_recall": 0.914349276974416,
+      "eval_Shipment_terms_f1": 0.6610878661087867,
+      "eval_Shipment_terms_number": 118,
+      "eval_Shipment_terms_precision": 0.6528925619834711,
+      "eval_Shipment_terms_recall": 0.6694915254237288,
+      "eval_Vessel_Requirements_f1": 0.40462427745664736,
+      "eval_Vessel_Requirements_number": 76,
+      "eval_Vessel_Requirements_precision": 0.36082474226804123,
+      "eval_Vessel_Requirements_recall": 0.4605263157894737,
+      "eval_loss": 0.13109955191612244,
+      "eval_overall_accuracy": 0.9686258668282501,
+      "eval_overall_f1": 0.8289348775393962,
+      "eval_overall_precision": 0.8095679584646764,
+      "eval_overall_recall": 0.8492511184594437,
+      "eval_runtime": 19.1254,
+      "eval_samples_per_second": 24.941,
+      "eval_steps_per_second": 3.137,
+      "step": 836
+    },
+    {
+      "epoch": 7.53,
+      "learning_rate": 1.2184873949579832e-05,
+      "loss": 0.0434,
+      "step": 900
+    },
+    {
+      "epoch": 8.0,
+      "eval_Cargo_Dimension_f1": 0.833976833976834,
+      "eval_Cargo_Dimension_number": 114,
+      "eval_Cargo_Dimension_precision": 0.7448275862068966,
+      "eval_Cargo_Dimension_recall": 0.9473684210526315,
+      "eval_Cargo_Quantity_f1": 0.8461538461538461,
+      "eval_Cargo_Quantity_number": 207,
+      "eval_Cargo_Quantity_precision": 0.7957446808510639,
+      "eval_Cargo_Quantity_recall": 0.9033816425120773,
+      "eval_Cargo_Requirements_f1": 0.5511482254697286,
+      "eval_Cargo_Requirements_number": 202,
+      "eval_Cargo_Requirements_precision": 0.47653429602888087,
+      "eval_Cargo_Requirements_recall": 0.6534653465346535,
+      "eval_Cargo_Stowage_Factor_f1": 0.8142292490118578,
+      "eval_Cargo_Stowage_Factor_number": 122,
+      "eval_Cargo_Stowage_Factor_precision": 0.7862595419847328,
+      "eval_Cargo_Stowage_Factor_recall": 0.8442622950819673,
+      "eval_Cargo_Type_f1": 0.8068424803991449,
+      "eval_Cargo_Type_number": 688,
+      "eval_Cargo_Type_precision": 0.7916083916083916,
+      "eval_Cargo_Type_recall": 0.8226744186046512,
+      "eval_Cargo_Weigh_Volume_f1": 0.8620919387075283,
+      "eval_Cargo_Weigh_Volume_number": 719,
+      "eval_Cargo_Weigh_Volume_precision": 0.8273657289002557,
+      "eval_Cargo_Weigh_Volume_recall": 0.8998609179415855,
+      "eval_Commission_rate_f1": 0.8364688856729378,
+      "eval_Commission_rate_number": 336,
+      "eval_Commission_rate_precision": 0.8140845070422535,
+      "eval_Commission_rate_recall": 0.8601190476190477,
+      "eval_Discharging_port_f1": 0.887463556851312,
+      "eval_Discharging_port_number": 843,
+      "eval_Discharging_port_precision": 0.8727064220183486,
+      "eval_Discharging_port_recall": 0.9027283511269276,
+      "eval_Laycan_date_f1": 0.845927379784102,
+      "eval_Laycan_date_number": 496,
+      "eval_Laycan_date_precision": 0.8240917782026769,
+      "eval_Laycan_date_recall": 0.8689516129032258,
+      "eval_Loading_Discharging_terms_f1": 0.7705882352941177,
+      "eval_Loading_Discharging_terms_number": 321,
+      "eval_Loading_Discharging_terms_precision": 0.7298050139275766,
+      "eval_Loading_Discharging_terms_recall": 0.8161993769470405,
+      "eval_Loading_port_f1": 0.9036873968079251,
+      "eval_Loading_port_number": 899,
+      "eval_Loading_port_precision": 0.8943355119825708,
+      "eval_Loading_port_recall": 0.9132369299221357,
+      "eval_Shipment_terms_f1": 0.6250000000000001,
+      "eval_Shipment_terms_number": 118,
+      "eval_Shipment_terms_precision": 0.5797101449275363,
+      "eval_Shipment_terms_recall": 0.6779661016949152,
+      "eval_Vessel_Requirements_f1": 0.4065934065934066,
+      "eval_Vessel_Requirements_number": 76,
+      "eval_Vessel_Requirements_precision": 0.3490566037735849,
+      "eval_Vessel_Requirements_recall": 0.4868421052631579,
+      "eval_loss": 0.14302846789360046,
+      "eval_overall_accuracy": 0.9681161092997086,
+      "eval_overall_f1": 0.827147798448163,
+      "eval_overall_precision": 0.7962562994960403,
+      "eval_overall_recall": 0.860532970239253,
+      "eval_runtime": 19.1728,
+      "eval_samples_per_second": 24.879,
+      "eval_steps_per_second": 3.129,
+      "step": 956
+    },
+    {
+      "epoch": 8.37,
+      "learning_rate": 7.983193277310924e-06,
+      "loss": 0.0373,
+      "step": 1000
+    },
+    {
+      "epoch": 9.0,
+      "eval_Cargo_Dimension_f1": 0.8372093023255814,
+      "eval_Cargo_Dimension_number": 114,
+      "eval_Cargo_Dimension_precision": 0.75,
+      "eval_Cargo_Dimension_recall": 0.9473684210526315,
+      "eval_Cargo_Quantity_f1": 0.847380410022779,
+      "eval_Cargo_Quantity_number": 207,
+      "eval_Cargo_Quantity_precision": 0.8017241379310345,
+      "eval_Cargo_Quantity_recall": 0.8985507246376812,
+      "eval_Cargo_Requirements_f1": 0.5508474576271186,
+      "eval_Cargo_Requirements_number": 202,
+      "eval_Cargo_Requirements_precision": 0.48148148148148145,
+      "eval_Cargo_Requirements_recall": 0.6435643564356436,
+      "eval_Cargo_Stowage_Factor_f1": 0.8387096774193549,
+      "eval_Cargo_Stowage_Factor_number": 122,
+      "eval_Cargo_Stowage_Factor_precision": 0.8253968253968254,
+      "eval_Cargo_Stowage_Factor_recall": 0.8524590163934426,
+      "eval_Cargo_Type_f1": 0.7960339943342777,
+      "eval_Cargo_Type_number": 688,
+      "eval_Cargo_Type_precision": 0.7762430939226519,
+      "eval_Cargo_Type_recall": 0.8168604651162791,
+      "eval_Cargo_Weigh_Volume_f1": 0.8713136729222519,
+      "eval_Cargo_Weigh_Volume_number": 719,
+      "eval_Cargo_Weigh_Volume_precision": 0.8408796895213454,
+      "eval_Cargo_Weigh_Volume_recall": 0.9040333796940194,
+      "eval_Commission_rate_f1": 0.8253968253968255,
+      "eval_Commission_rate_number": 336,
+      "eval_Commission_rate_precision": 0.8011204481792717,
+      "eval_Commission_rate_recall": 0.8511904761904762,
+      "eval_Discharging_port_f1": 0.87995337995338,
+      "eval_Discharging_port_number": 843,
+      "eval_Discharging_port_precision": 0.8648339060710195,
+      "eval_Discharging_port_recall": 0.8956109134045077,
+      "eval_Laycan_date_f1": 0.8501469147894222,
+      "eval_Laycan_date_number": 496,
+      "eval_Laycan_date_precision": 0.8266666666666667,
+      "eval_Laycan_date_recall": 0.875,
+      "eval_Loading_Discharging_terms_f1": 0.7610619469026548,
+      "eval_Loading_Discharging_terms_number": 321,
+      "eval_Loading_Discharging_terms_precision": 0.7226890756302521,
+      "eval_Loading_Discharging_terms_recall": 0.8037383177570093,
+      "eval_Loading_port_f1": 0.9076086956521738,
+      "eval_Loading_port_number": 899,
+      "eval_Loading_port_precision": 0.8873538788522848,
+      "eval_Loading_port_recall": 0.92880978865406,
+      "eval_Shipment_terms_f1": 0.6557377049180327,
+      "eval_Shipment_terms_number": 118,
+      "eval_Shipment_terms_precision": 0.6349206349206349,
+      "eval_Shipment_terms_recall": 0.6779661016949152,
+      "eval_Vessel_Requirements_f1": 0.4262295081967213,
+      "eval_Vessel_Requirements_number": 76,
+      "eval_Vessel_Requirements_precision": 0.3644859813084112,
+      "eval_Vessel_Requirements_recall": 0.5131578947368421,
+      "eval_loss": 0.14348047971725464,
+      "eval_overall_accuracy": 0.9685777764953689,
+      "eval_overall_f1": 0.8277860882572925,
+      "eval_overall_precision": 0.7969396939693969,
+      "eval_overall_recall": 0.8611165142968294,
+      "eval_runtime": 19.1339,
+      "eval_samples_per_second": 24.93,
+      "eval_steps_per_second": 3.136,
+      "step": 1075
+    },
+    {
+      "epoch": 9.21,
+      "learning_rate": 3.7815126050420167e-06,
+      "loss": 0.0348,
+      "step": 1100
+    },
+    {
+      "epoch": 9.96,
+      "eval_Cargo_Dimension_f1": 0.8437499999999999,
+      "eval_Cargo_Dimension_number": 114,
+      "eval_Cargo_Dimension_precision": 0.7605633802816901,
+      "eval_Cargo_Dimension_recall": 0.9473684210526315,
+      "eval_Cargo_Quantity_f1": 0.8486238532110092,
+      "eval_Cargo_Quantity_number": 207,
+      "eval_Cargo_Quantity_precision": 0.8078602620087336,
+      "eval_Cargo_Quantity_recall": 0.893719806763285,
+      "eval_Cargo_Requirements_f1": 0.5641025641025641,
+      "eval_Cargo_Requirements_number": 202,
+      "eval_Cargo_Requirements_precision": 0.49624060150375937,
+      "eval_Cargo_Requirements_recall": 0.6534653465346535,
+      "eval_Cargo_Stowage_Factor_f1": 0.829268292682927,
+      "eval_Cargo_Stowage_Factor_number": 122,
+      "eval_Cargo_Stowage_Factor_precision": 0.8225806451612904,
+      "eval_Cargo_Stowage_Factor_recall": 0.8360655737704918,
+      "eval_Cargo_Type_f1": 0.8031383737517832,
+      "eval_Cargo_Type_number": 688,
+      "eval_Cargo_Type_precision": 0.788515406162465,
+      "eval_Cargo_Type_recall": 0.8183139534883721,
+      "eval_Cargo_Weigh_Volume_f1": 0.8770270270270271,
+      "eval_Cargo_Weigh_Volume_number": 719,
+      "eval_Cargo_Weigh_Volume_precision": 0.8528252299605782,
+      "eval_Cargo_Weigh_Volume_recall": 0.9026425591098748,
+      "eval_Commission_rate_f1": 0.8196248196248196,
+      "eval_Commission_rate_number": 336,
+      "eval_Commission_rate_precision": 0.7955182072829131,
+      "eval_Commission_rate_recall": 0.8452380952380952,
+      "eval_Discharging_port_f1": 0.8857808857808858,
+      "eval_Discharging_port_number": 843,
+      "eval_Discharging_port_precision": 0.870561282932417,
+      "eval_Discharging_port_recall": 0.9015421115065243,
+      "eval_Laycan_date_f1": 0.8478900883218843,
+      "eval_Laycan_date_number": 496,
+      "eval_Laycan_date_precision": 0.8260038240917782,
+      "eval_Laycan_date_recall": 0.8709677419354839,
+      "eval_Loading_Discharging_terms_f1": 0.757396449704142,
+      "eval_Loading_Discharging_terms_number": 321,
+      "eval_Loading_Discharging_terms_precision": 0.7211267605633803,
+      "eval_Loading_Discharging_terms_recall": 0.7975077881619937,
+      "eval_Loading_port_f1": 0.9066084107045331,
+      "eval_Loading_port_number": 899,
+      "eval_Loading_port_precision": 0.8905579399141631,
+      "eval_Loading_port_recall": 0.9232480533926585,
+      "eval_Shipment_terms_f1": 0.6779661016949152,
+      "eval_Shipment_terms_number": 118,
+      "eval_Shipment_terms_precision": 0.6779661016949152,
+      "eval_Shipment_terms_recall": 0.6779661016949152,
+      "eval_Vessel_Requirements_f1": 0.4357541899441341,
+      "eval_Vessel_Requirements_number": 76,
+      "eval_Vessel_Requirements_precision": 0.3786407766990291,
+      "eval_Vessel_Requirements_recall": 0.5131578947368421,
+      "eval_loss": 0.14810970425605774,
+      "eval_overall_accuracy": 0.9687605197603177,
+      "eval_overall_f1": 0.8309832675314909,
+      "eval_overall_precision": 0.8040749499727123,
+      "eval_overall_recall": 0.859754911495818,
+      "eval_runtime": 19.1898,
+      "eval_samples_per_second": 24.857,
+      "eval_steps_per_second": 3.127,
+      "step": 1190
+    },
+    {
+      "epoch": 9.96,
+      "step": 1190,
+      "total_flos": 1.7625685852013568e+16,
+      "train_loss": 0.0958036256437542,
+      "train_runtime": 2372.2017,
+      "train_samples_per_second": 8.031,
+      "train_steps_per_second": 0.502
+    }
+  ],
+  "logging_steps": 100,
+  "max_steps": 1190,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 10,
+  "save_steps": 500,
+  "total_flos": 1.7625685852013568e+16,
+  "trial_name": null,
+  "trial_params": null
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5148dd5973813f4a3f2b98f2973f38fad6ac2e76e3927b4d146e1fe4d59629a0
+size 4728