Nelci commited on
Commit
0b85ca5
·
1 Parent(s): cc24192

Training in progress, epoch 2

Browse files
Files changed (2) hide show
  1. README.md +0 -76
  2. pytorch_model.bin +1 -1
README.md DELETED
@@ -1,76 +0,0 @@
1
- ---
2
- license: mit
3
- base_model: neuralmind/bert-large-portuguese-cased
4
- tags:
5
- - generated_from_trainer
6
- datasets:
7
- - hate_speech_portuguese
8
- metrics:
9
- - accuracy
10
- model-index:
11
- - name: bertimbau_hate_speech
12
- results:
13
- - task:
14
- name: Text Classification
15
- type: text-classification
16
- dataset:
17
- name: hate_speech_portuguese
18
- type: hate_speech_portuguese
19
- config: default
20
- split: train
21
- args: default
22
- metrics:
23
- - name: Accuracy
24
- type: accuracy
25
- value: 0.7751322751322751
26
- ---
27
-
28
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
29
- should probably proofread and complete it, then remove this comment. -->
30
-
31
- # bertimbau_hate_speech
32
-
33
- This model is a fine-tuned version of [neuralmind/bert-large-portuguese-cased](https://huggingface.co/neuralmind/bert-large-portuguese-cased) on the hate_speech_portuguese dataset.
34
- It achieves the following results on the evaluation set:
35
- - Loss: 0.5011
36
- - Accuracy: 0.7751
37
-
38
- ## Model description
39
-
40
- More information needed
41
-
42
- ## Intended uses & limitations
43
-
44
- More information needed
45
-
46
- ## Training and evaluation data
47
-
48
- More information needed
49
-
50
- ## Training procedure
51
-
52
- ### Training hyperparameters
53
-
54
- The following hyperparameters were used during training:
55
- - learning_rate: 2e-05
56
- - train_batch_size: 16
57
- - eval_batch_size: 16
58
- - seed: 42
59
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
60
- - lr_scheduler_type: linear
61
- - num_epochs: 2
62
-
63
- ### Training results
64
-
65
- | Training Loss | Epoch | Step | Validation Loss | Accuracy |
66
- |:-------------:|:-----:|:----:|:---------------:|:--------:|
67
- | No log | 1.0 | 284 | 0.4564 | 0.7787 |
68
- | 0.4227 | 2.0 | 568 | 0.5011 | 0.7751 |
69
-
70
-
71
- ### Framework versions
72
-
73
- - Transformers 4.31.0
74
- - Pytorch 2.0.1+cpu
75
- - Datasets 2.14.4
76
- - Tokenizers 0.13.3
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f6be66cc0db328d0c6c5d0c047a10e1aa1ef5b4a79a2d871ad2dfc117ec2521a
3
  size 1337728750
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:997be131ef8cb5fa308e96fb25252d7264b5102c6ec491f1dea288eeeb18e09f
3
  size 1337728750