fine_tuned_copa_croslo

README.md

@@ -19,8 +19,8 @@ should probably proofread and complete it, then remove this comment. -->
 This model is a fine-tuned version of [EMBEDDIA/crosloengual-bert](https://huggingface.co/EMBEDDIA/crosloengual-bert) on an unknown dataset.
 It achieves the following results on the evaluation set:
 - Loss: 0.6931
-- Accuracy: 0.51
-- F1: 0.4857
+- Accuracy: 0.55
+- F1: 0.3903
 
 ## Model description
 
@@ -51,19 +51,19 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
-| 0.7257        | 1.0   | 50   | 0.6931          | 0.49     | 0.4838 |
-| 0.7001        | 2.0   | 100  | 0.6931          | 0.48     | 0.48   |
-| 0.7196        | 3.0   | 150  | 0.6931          | 0.52     | 0.4603 |
-| 0.6895        | 4.0   | 200  | 0.6931          | 0.5      | 0.4926 |
-| 0.745         | 5.0   | 250  | 0.6931          | 0.46     | 0.4244 |
-| 0.7102        | 6.0   | 300  | 0.6931          | 0.5      | 0.4861 |
-| 0.7245        | 7.0   | 350  | 0.6931          | 0.55     | 0.5391 |
-| 0.7283        | 8.0   | 400  | 0.6931          | 0.51     | 0.4857 |
+| 0.7051        | 1.0   | 50   | 0.6931          | 0.53     | 0.5281 |
+| 0.715         | 2.0   | 100  | 0.6931          | 0.55     | 0.3903 |
+| 0.726         | 3.0   | 150  | 0.6931          | 0.55     | 0.3903 |
+| 0.6975        | 4.0   | 200  | 0.6931          | 0.55     | 0.3903 |
+| 0.7389        | 5.0   | 250  | 0.6931          | 0.6      | 0.5347 |
+| 0.7271        | 6.0   | 300  | 0.6931          | 0.55     | 0.3903 |
+| 0.7325        | 7.0   | 350  | 0.6931          | 0.55     | 0.3903 |
+| 0.706         | 8.0   | 400  | 0.6931          | 0.55     | 0.3903 |
 
 
 ### Framework versions
 
-- Transformers 4.40.1
-- Pytorch 2.3.0
-- Datasets 2.19.0
+- Transformers 4.41.0
+- Pytorch 2.3.0+cu121
+- Datasets 2.19.1
 - Tokenizers 0.19.1

config.json

@@ -18,7 +18,7 @@
   "pad_token_id": 0,
   "position_embedding_type": "absolute",
   "torch_dtype": "float32",
-  "transformers_version": "4.40.1",
+  "transformers_version": "4.41.0",
   "type_vocab_size": 2,
   "use_cache": false,
   "vocab_size": 49601

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:078229674b602cebc2e73bb19baa1870e450d8f9a48a2938e0000e2788a8ccca
+oid sha256:bc8aab24015c318f1220da9eb12b56c3387677fc083e4f10aee80f12bc86f1b3
 size 496566268

runs/May23_19-31-14_c32a3a36510c/events.out.tfevents.1716492676.c32a3a36510c.559.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7f689a43ccf3e2a9fa6f014f69f2f5f7f2f42bfae54e3781140b77a5f99f8971
+size 9767

runs/May23_19-31-14_c32a3a36510c/events.out.tfevents.1716492719.c32a3a36510c.559.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:750e830202c57bd6bab75fb0de665f813a017855c809ef15e6dc7cd7e66acb88
+size 826

tokenizer.json

@@ -1,6 +1,11 @@
 {
   "version": "1.0",
-  "truncation": null,
+  "truncation": {
+    "direction": "Right",
+    "max_length": 512,
+    "strategy": "LongestFirst",
+    "stride": 0
+  },
   "padding": null,
   "added_tokens": [
     {

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3ace018d56ec1c3c748ee48a4ed42c42943ba1f32eca44998e0f5bdf525c5f58
-size 4984
+oid sha256:b9eaad88b88bac77ad74619fbc164a6ff350b82a02ffee2ea60b935029d384ba
+size 5112