End of training

README.md

@@ -0,0 +1,69 @@
+---
+license: mit
+base_model: FacebookAI/xlm-roberta-large
+tags:
+- generated_from_trainer
+metrics:
+- f1
+model-index:
+- name: clef1ar
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# clef1ar
+
+This model is a fine-tuned version of [FacebookAI/xlm-roberta-large](https://huggingface.co/FacebookAI/xlm-roberta-large) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.4347
+- F1: 0.6539
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 3e-05
+- train_batch_size: 16
+- eval_batch_size: 16
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 5
+
+### Training results
+
+| Training Loss | Epoch  | Step | Validation Loss | F1     |
+|:-------------:|:------:|:----:|:---------------:|:------:|
+| 0.5791        | 0.4843 | 200  | 0.5243          | 0.0    |
+| 0.5199        | 0.9685 | 400  | 0.4892          | 0.5056 |
+| 0.4637        | 1.4528 | 600  | 0.4469          | 0.5788 |
+| 0.4391        | 1.9370 | 800  | 0.4363          | 0.5637 |
+| 0.4206        | 2.4213 | 1000 | 0.4347          | 0.6539 |
+| 0.4189        | 2.9056 | 1200 | 0.4250          | 0.6359 |
+| 0.4049        | 3.3898 | 1400 | 0.4270          | 0.6217 |
+| 0.3796        | 3.8741 | 1600 | 0.4386          | 0.6212 |
+| 0.4007        | 4.3584 | 1800 | 0.4310          | 0.6301 |
+| 0.3785        | 4.8426 | 2000 | 0.4315          | 0.6205 |
+
+
+### Framework versions
+
+- Transformers 4.40.1
+- Pytorch 2.2.1+cu121
+- Datasets 2.19.1
+- Tokenizers 0.19.1

config.json

@@ -0,0 +1,29 @@
+{
+  "_name_or_path": "FacebookAI/xlm-roberta-large",
+  "architectures": [
+    "XLMRobertaForSequenceClassification"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "bos_token_id": 0,
+  "classifier_dropout": null,
+  "eos_token_id": 2,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 1024,
+  "initializer_range": 0.02,
+  "intermediate_size": 4096,
+  "layer_norm_eps": 1e-05,
+  "max_position_embeddings": 514,
+  "model_type": "xlm-roberta",
+  "num_attention_heads": 16,
+  "num_hidden_layers": 24,
+  "output_past": true,
+  "pad_token_id": 1,
+  "position_embedding_type": "absolute",
+  "problem_type": "single_label_classification",
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.40.1",
+  "type_vocab_size": 1,
+  "use_cache": true,
+  "vocab_size": 250002
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d302764b9e0a63ad4a96eabd124feb4be38cd88907765eb49e59745c996b4b83
+size 1119833476

runs/May06_17-28-42_8460414a7e61/events.out.tfevents.1715016523.8460414a7e61.2273.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:70677f04e170324f2c5ecbd9d32c85349b438a8713308f20a59a01f2bbaf5d33
+size 5242

runs/May06_17-31-57_8460414a7e61/events.out.tfevents.1715016718.8460414a7e61.4184.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9dc693f01d896f7b63c220ff966e587c5e935f441a2087669617b96a3c7b8ab3
+size 10355

runs/May06_17-31-57_8460414a7e61/events.out.tfevents.1715018807.8460414a7e61.4184.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2a21e42b9bfbeb5d4907ceeff51c9646e66f5fdadb33498d653aae67759782af
+size 722

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dabac05dabee16b858a78216541c7bb020adee3a65943a80f7436b76e7851337
+size 4984