Training in Colab

README.md

@@ -20,11 +20,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert-base-cased](https://huggingface.co/distilbert-base-cased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0629
-- Precision: 0.7480
-- Recall: 0.8221
-- F1: 0.7833
-- Accuracy: 0.9762
+- Loss: 0.0339
+- Precision: 0.9204
+- Recall: 0.9372
+- F1: 0.9287
+- Accuracy: 0.9926
 
 ## Model description
 
@@ -49,20 +49,22 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 3
+- num_epochs: 5
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1     | Accuracy |
-|:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
-| 0.0866        | 1.0   | 125  | 0.0586          | 0.7396    | 0.7230 | 0.7312 | 0.9737   |
-| 0.0314        | 2.0   | 250  | 0.0588          | 0.7379    | 0.8243 | 0.7787 | 0.9754   |
-| 0.0175        | 3.0   | 375  | 0.0629          | 0.7480    | 0.8221 | 0.7833 | 0.9762   |
+| Training Loss | Epoch | Step  | Validation Loss | Precision | Recall | F1     | Accuracy |
+|:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:------:|:--------:|
+| 0.029         | 1.0   | 3546  | 0.0320          | 0.8804    | 0.9079 | 0.8940 | 0.9889   |
+| 0.018         | 2.0   | 7092  | 0.0276          | 0.9024    | 0.9318 | 0.9169 | 0.9914   |
+| 0.0111        | 3.0   | 10638 | 0.0286          | 0.9136    | 0.9311 | 0.9223 | 0.9920   |
+| 0.0067        | 4.0   | 14184 | 0.0322          | 0.9150    | 0.9357 | 0.9252 | 0.9923   |
+| 0.0066        | 5.0   | 17730 | 0.0339          | 0.9204    | 0.9372 | 0.9287 | 0.9926   |
 
 
 ### Framework versions
 
-- Transformers 4.38.2
-- Pytorch 2.2.1
+- Transformers 4.38.1
+- Pytorch 2.1.0+cu121
 - Datasets 2.18.0
 - Tokenizers 0.15.2

config.json

@@ -34,6 +34,6 @@
   "sinusoidal_pos_embds": false,
   "tie_weights_": true,
   "torch_dtype": "float32",
-  "transformers_version": "4.38.2",
+  "transformers_version": "4.38.1",
   "vocab_size": 28996
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5de1fffeb11369bfefe60d49f051be9033032993102cea345b8171fc2cf7e8e6
+oid sha256:441f745fd04791aa54b58ea77429329e0f258334105effc83b29a0820337c767
 size 260791364

runs/Mar03_20-45-05_0bb298d40f89/events.out.tfevents.1709498705.0bb298d40f89.688.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:40b7a91fe881f703f99f0f59b5308a66666bf98f71458e1c9b5ca205a663aebf
+size 14217

runs/Mar03_20-45-05_0bb298d40f89/events.out.tfevents.1709498915.0bb298d40f89.688.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d8530cb67836d8d13d5fdff06b01f8f248c0575cfba7f5243c3ee12a43b3c7a
+size 560

runs/Mar03_20-52-27_0bb298d40f89/events.out.tfevents.1709499153.0bb298d40f89.688.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:54e03e981ae17541d6e207a59086261362f6632035032d3f23a713413db5eee2
+size 82532

runs/Mar03_20-52-27_0bb298d40f89/events.out.tfevents.1709501485.0bb298d40f89.688.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e098d0785261f6d0ed302b1e9507af04e1f2e3fb8c3ddb366836cdc375de6063
+size 569

tokenizer.json

@@ -1,6 +1,11 @@
 {
   "version": "1.0",
-  "truncation": null,
+  "truncation": {
+    "direction": "Right",
+    "max_length": 512,
+    "strategy": "LongestFirst",
+    "stride": 0
+  },
   "padding": null,
   "added_tokens": [
     {

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:682b25213041e819d3ab6743508a63b38cf55658f89a2083981d9dfc41aca58b
-size 4856
+oid sha256:3dd5c15ddeba2a82a78e62eb932ba1603b48d678b2f7c7e1e5c81427c74ae18e
+size 4920