atakanince commited on
Commit
3b57c61
1 Parent(s): e6514a9

End of training

Browse files
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - tr
4
+ license: apache-2.0
5
+ base_model: distilbert/distilbert-base-uncased
6
+ tags:
7
+ - generated_from_trainer
8
+ datasets:
9
+ - Toygar/turkish-offensive-language-detection
10
+ metrics:
11
+ - accuracy
12
+ model-index:
13
+ - name: Distilbert Base Uncased Turkish Offensive Language Classifier - Atakan Ince
14
+ results: []
15
+ ---
16
+
17
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
18
+ should probably proofread and complete it, then remove this comment. -->
19
+
20
+ # Distilbert Base Uncased Turkish Offensive Language Classifier - Atakan Ince
21
+
22
+ This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on the Turkish Offensive Language Dataset dataset.
23
+ It achieves the following results on the evaluation set:
24
+ - Loss: 0.2440
25
+ - Accuracy: 0.9067
26
+
27
+ ## Model description
28
+
29
+ More information needed
30
+
31
+ ## Intended uses & limitations
32
+
33
+ More information needed
34
+
35
+ ## Training and evaluation data
36
+
37
+ More information needed
38
+
39
+ ## Training procedure
40
+
41
+ ### Training hyperparameters
42
+
43
+ The following hyperparameters were used during training:
44
+ - learning_rate: 1e-05
45
+ - train_batch_size: 16
46
+ - eval_batch_size: 8
47
+ - seed: 42
48
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
+ - lr_scheduler_type: linear
50
+ - lr_scheduler_warmup_steps: 500
51
+ - training_steps: 4000
52
+ - mixed_precision_training: Native AMP
53
+
54
+ ### Training results
55
+
56
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
57
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
58
+ | 0.3075 | 0.36 | 1000 | 0.2871 | 0.8901 |
59
+ | 0.2652 | 0.72 | 2000 | 0.2520 | 0.9031 |
60
+ | 0.2825 | 1.09 | 3000 | 0.2506 | 0.9007 |
61
+ | 0.2471 | 1.45 | 4000 | 0.2440 | 0.9067 |
62
+
63
+
64
+ ### Framework versions
65
+
66
+ - Transformers 4.38.2
67
+ - Pytorch 2.1.0+cu121
68
+ - Datasets 2.18.0
69
+ - Tokenizers 0.15.2
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ebff5fbeadecf984ce4f7bb153ef9f7486fad1f1a6df6b6b6ae1706af7202d8c
3
  size 267832560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ac0aeeec67270a9d1e81f6b8921c57192ef6f2966ffa8881843a3ff717695ba
3
  size 267832560
runs/Mar05_22-01-26_1161259d5144/events.out.tfevents.1709676135.1161259d5144.1885.2 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7a65aad3317b904faa9fb6d02e711de8467a7fe5edf2192b9db4082c14ba9c68
3
- size 30845
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c7218691d806c92419fdd1cd558f9996206faa1ac62d773011a5326f2dc2031
3
+ size 39962