Pushing of the new best model checkpoint

README.md

@@ -0,0 +1,77 @@
+---
+library_name: transformers
+license: mit
+base_model: dbmdz/bert-base-turkish-cased
+tags:
+- generated_from_trainer
+metrics:
+- f1
+model-index:
+- name: turkish-question-answering
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# turkish-question-answering
+
+This model is a fine-tuned version of [dbmdz/bert-base-turkish-cased](https://huggingface.co/dbmdz/bert-base-turkish-cased) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.9487
+- Exact Match: 37.6944
+- F1: 53.7649
+- Valid Predictions: 1093
+- Valid Samples: 1093
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 32
+- eval_batch_size: 64
+- seed: 42
+- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_ratio: 0.1
+- num_epochs: 3
+
+### Training results
+
+| Training Loss | Epoch  | Step | Validation Loss | Exact Match | F1      | Valid Predictions | Valid Samples |
+|:-------------:|:------:|:----:|:---------------:|:-----------:|:-------:|:-----------------:|:-------------:|
+| 2.9036        | 0.0603 | 200  | 4.5411          | 0.0         | 0.0     | 1187              | 1187          |
+| 2.1368        | 0.1207 | 400  | 2.9291          | 18.0871     | 25.2546 | 1056              | 1056          |
+| 1.8916        | 0.1810 | 600  | 2.4409          | 29.6756     | 41.1881 | 1048              | 1048          |
+| 1.8242        | 0.2413 | 800  | 2.7636          | 12.2760     | 15.7271 | 1116              | 1116          |
+| 1.7819        | 0.3017 | 1000 | 2.4051          | 23.5067     | 32.4574 | 1038              | 1038          |
+| 1.6125        | 0.3620 | 1200 | 2.1023          | 32.8358     | 47.2831 | 1072              | 1072          |
+| 1.5859        | 0.4223 | 1400 | 2.3902          | 24.1950     | 32.2466 | 1087              | 1087          |
+| 1.5177        | 0.4827 | 1600 | 2.3095          | 23.6279     | 31.4443 | 1075              | 1075          |
+| 1.4936        | 0.5430 | 1800 | 1.9979          | 38.2054     | 53.0565 | 1081              | 1081          |
+| 1.5517        | 0.6033 | 2000 | 1.9487          | 37.6944     | 53.7649 | 1093              | 1093          |
+| 1.4981        | 0.6637 | 2200 | 1.9730          | 36.4220     | 52.1297 | 1090              | 1090          |
+| 1.4405        | 0.7240 | 2400 | 1.9899          | 36.0507     | 48.8318 | 1104              | 1104          |
+| 1.4102        | 0.7843 | 2600 | 2.0059          | 36.5832     | 49.1061 | 1118              | 1118          |
+
+
+### Framework versions
+
+- Transformers 4.48.0.dev0
+- Pytorch 2.4.1+cu121
+- Datasets 2.20.0
+- Tokenizers 0.21.0

config.json

@@ -0,0 +1,25 @@
+{
+  "_name_or_path": "dbmdz/bert-base-turkish-cased",
+  "architectures": [
+    "BertForQuestionAnswering"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "classifier_dropout": null,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 768,
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "bert",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "pad_token_id": 0,
+  "position_embedding_type": "absolute",
+  "torch_dtype": "float32",
+  "transformers_version": "4.48.0.dev0",
+  "type_vocab_size": 2,
+  "use_cache": true,
+  "vocab_size": 32000
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2b16c685ecc6707eaaabe67c6fd68077f9f8ec6e4dad58ad584ba110c76b74eb
+size 440136504

special_tokens_map.json

@@ -0,0 +1,7 @@
+{
+  "cls_token": "[CLS]",
+  "mask_token": "[MASK]",
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "unk_token": "[UNK]"
+}

tokenizer_config.json

@@ -0,0 +1,59 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "4": {
+      "content": "[MASK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "[CLS]",
+  "do_basic_tokenize": true,
+  "do_lower_case": false,
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "max_len": 512,
+  "model_max_length": 512,
+  "never_split": null,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "unk_token": "[UNK]"
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0fcb374d58be194e45d2433d88b6917339e48d63b327bb03cbf2e926b3f21227
+size 5432