Hugging Face's logo

henryscheible
/
bert-large-uncased_crows_pairs_finetuned

Text Classification
Transformers
PyTorch
bert
Generated from Trainer
Eval Results
Inference Endpoints
Model card Files Community
2
henryscheible commited on
Commit
576977f
•
1 Parent(s): 07cbe78

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +61 -61
README.md CHANGED
@@ -21,7 +21,7 @@ model-index:
21
  metrics:
22
  - name: Accuracy
23
  type: accuracy
24
- value: 0.46688741721854304
25
  ---
26
 
27
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -31,8 +31,8 @@ should probably proofread and complete it, then remove this comment. -->
31
 
32
  This model is a fine-tuned version of [bert-large-uncased](https://huggingface.co/bert-large-uncased) on the crows_pairs dataset.
33
  It achieves the following results on the evaluation set:
34
- - Loss: 0.6936
35
- - Accuracy: 0.4669
36
 
37
  ## Model description
38
 
@@ -51,7 +51,7 @@ More information needed
51
  ### Training hyperparameters
52
 
53
  The following hyperparameters were used during training:
54
- - learning_rate: 0.0005
55
  - train_batch_size: 64
56
  - eval_batch_size: 64
57
  - seed: 42
@@ -63,63 +63,63 @@ The following hyperparameters were used during training:
63
 
64
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
65
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
66
- | 0.8146 | 0.53 | 10 | 0.6914 | 0.5331 |
67
- | 0.7104 | 1.05 | 20 | 0.6910 | 0.5331 |
68
- | 0.7078 | 1.58 | 30 | 0.7292 | 0.4669 |
69
- | 0.716 | 2.11 | 40 | 0.7033 | 0.4669 |
70
- | 0.7273 | 2.63 | 50 | 0.6946 | 0.5331 |
71
- | 0.7285 | 3.16 | 60 | 0.6983 | 0.5331 |
72
- | 0.7244 | 3.68 | 70 | 0.6958 | 0.5331 |
73
- | 0.7283 | 4.21 | 80 | 0.7013 | 0.4669 |
74
- | 0.7131 | 4.74 | 90 | 0.7063 | 0.4669 |
75
- | 0.7144 | 5.26 | 100 | 0.7149 | 0.4669 |
76
- | 0.7237 | 5.79 | 110 | 0.6913 | 0.5331 |
77
- | 0.7074 | 6.32 | 120 | 0.6922 | 0.5331 |
78
- | 0.7034 | 6.84 | 130 | 0.6910 | 0.5331 |
79
- | 0.699 | 7.37 | 140 | 0.7251 | 0.4669 |
80
- | 0.7183 | 7.89 | 150 | 0.7216 | 0.5331 |
81
- | 0.7106 | 8.42 | 160 | 0.7046 | 0.4669 |
82
- | 0.7107 | 8.95 | 170 | 0.6923 | 0.5331 |
83
- | 0.6963 | 9.47 | 180 | 0.7056 | 0.4669 |
84
- | 0.7068 | 10.0 | 190 | 0.6911 | 0.5331 |
85
- | 0.7088 | 10.53 | 200 | 0.6963 | 0.4669 |
86
- | 0.7074 | 11.05 | 210 | 0.7269 | 0.4669 |
87
- | 0.7233 | 11.58 | 220 | 0.6995 | 0.5331 |
88
- | 0.7261 | 12.11 | 230 | 0.6921 | 0.5331 |
89
- | 0.6997 | 12.63 | 240 | 0.6971 | 0.4669 |
90
- | 0.6993 | 13.16 | 250 | 0.7103 | 0.4669 |
91
- | 0.7073 | 13.68 | 260 | 0.6923 | 0.5331 |
92
- | 0.697 | 14.21 | 270 | 0.6938 | 0.4669 |
93
- | 0.7057 | 14.74 | 280 | 0.6948 | 0.5331 |
94
- | 0.7165 | 15.26 | 290 | 0.7053 | 0.4669 |
95
- | 0.7172 | 15.79 | 300 | 0.6910 | 0.5331 |
96
- | 0.7152 | 16.32 | 310 | 0.6921 | 0.5331 |
97
- | 0.7115 | 16.84 | 320 | 0.7050 | 0.4669 |
98
- | 0.7202 | 17.37 | 330 | 0.6911 | 0.5331 |
99
- | 0.7069 | 17.89 | 340 | 0.6952 | 0.4669 |
100
- | 0.7061 | 18.42 | 350 | 0.6914 | 0.5331 |
101
- | 0.7023 | 18.95 | 360 | 0.6943 | 0.4669 |
102
- | 0.7045 | 19.47 | 370 | 0.6911 | 0.5331 |
103
- | 0.7114 | 20.0 | 380 | 0.6925 | 0.5331 |
104
- | 0.6922 | 20.53 | 390 | 0.6910 | 0.5331 |
105
- | 0.7097 | 21.05 | 400 | 0.6919 | 0.5331 |
106
- | 0.7142 | 21.58 | 410 | 0.6946 | 0.4669 |
107
- | 0.7113 | 22.11 | 420 | 0.6933 | 0.4669 |
108
- | 0.6979 | 22.63 | 430 | 0.6934 | 0.5331 |
109
- | 0.7214 | 23.16 | 440 | 0.7112 | 0.4669 |
110
- | 0.6974 | 23.68 | 450 | 0.6929 | 0.5331 |
111
- | 0.7077 | 24.21 | 460 | 0.6918 | 0.5331 |
112
- | 0.7123 | 24.74 | 470 | 0.7006 | 0.4669 |
113
- | 0.7065 | 25.26 | 480 | 0.6978 | 0.4669 |
114
- | 0.7079 | 25.79 | 490 | 0.6922 | 0.5331 |
115
- | 0.7063 | 26.32 | 500 | 0.6991 | 0.4669 |
116
- | 0.7182 | 26.84 | 510 | 0.6956 | 0.4669 |
117
- | 0.7061 | 27.37 | 520 | 0.6914 | 0.5331 |
118
- | 0.7069 | 27.89 | 530 | 0.6912 | 0.5331 |
119
- | 0.7024 | 28.42 | 540 | 0.6929 | 0.5331 |
120
- | 0.701 | 28.95 | 550 | 0.6954 | 0.4669 |
121
- | 0.7131 | 29.47 | 560 | 0.6942 | 0.4669 |
122
- | 0.6999 | 30.0 | 570 | 0.6936 | 0.4669 |
123
 
124
 
125
  ### Framework versions
 
21
  metrics:
22
  - name: Accuracy
23
  type: accuracy
24
+ value: 0.7483443708609272
25
  ---
26
 
27
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
31
 
32
  This model is a fine-tuned version of [bert-large-uncased](https://huggingface.co/bert-large-uncased) on the crows_pairs dataset.
33
  It achieves the following results on the evaluation set:
34
+ - Loss: 1.8687
35
+ - Accuracy: 0.7483
36
 
37
  ## Model description
38
 
 
51
  ### Training hyperparameters
52
 
53
  The following hyperparameters were used during training:
54
+ - learning_rate: 5e-05
55
  - train_batch_size: 64
56
  - eval_batch_size: 64
57
  - seed: 42
 
63
 
64
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
65
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
66
+ | 0.7241 | 0.53 | 10 | 0.7015 | 0.4868 |
67
+ | 0.6975 | 1.05 | 20 | 0.7124 | 0.4934 |
68
+ | 0.6992 | 1.58 | 30 | 0.7102 | 0.4901 |
69
+ | 0.6941 | 2.11 | 40 | 0.6890 | 0.5430 |
70
+ | 0.665 | 2.63 | 50 | 0.6981 | 0.5464 |
71
+ | 0.5656 | 3.16 | 60 | 0.5434 | 0.7119 |
72
+ | 0.3695 | 3.68 | 70 | 0.7431 | 0.7152 |
73
+ | 0.3913 | 4.21 | 80 | 0.7834 | 0.7185 |
74
+ | 0.2617 | 4.74 | 90 | 0.6394 | 0.7318 |
75
+ | 0.1225 | 5.26 | 100 | 0.8882 | 0.6921 |
76
+ | 0.1549 | 5.79 | 110 | 0.8629 | 0.7119 |
77
+ | 0.1094 | 6.32 | 120 | 1.0113 | 0.7185 |
78
+ | 0.0418 | 6.84 | 130 | 1.2568 | 0.7219 |
79
+ | 0.023 | 7.37 | 140 | 1.3223 | 0.7417 |
80
+ | 0.045 | 7.89 | 150 | 1.5015 | 0.7086 |
81
+ | 0.0216 | 8.42 | 160 | 1.1833 | 0.7550 |
82
+ | 0.0084 | 8.95 | 170 | 1.4125 | 0.7318 |
83
+ | 0.0198 | 9.47 | 180 | 1.5301 | 0.7152 |
84
+ | 0.0061 | 10.0 | 190 | 1.3163 | 0.7483 |
85
+ | 0.0041 | 10.53 | 200 | 1.3083 | 0.7517 |
86
+ | 0.0046 | 11.05 | 210 | 1.4028 | 0.7616 |
87
+ | 0.0034 | 11.58 | 220 | 1.5256 | 0.7583 |
88
+ | 0.0012 | 12.11 | 230 | 1.6067 | 0.7583 |
89
+ | 0.001 | 12.63 | 240 | 1.6199 | 0.7649 |
90
+ | 0.005 | 13.16 | 250 | 1.7140 | 0.7384 |
91
+ | 0.0031 | 13.68 | 260 | 1.7680 | 0.7318 |
92
+ | 0.0008 | 14.21 | 270 | 1.7353 | 0.7252 |
93
+ | 0.0026 | 14.74 | 280 | 1.7242 | 0.7450 |
94
+ | 0.0013 | 15.26 | 290 | 1.7290 | 0.7483 |
95
+ | 0.0001 | 15.79 | 300 | 1.7421 | 0.7450 |
96
+ | 0.0008 | 16.32 | 310 | 1.7536 | 0.7450 |
97
+ | 0.0013 | 16.84 | 320 | 1.7588 | 0.7483 |
98
+ | 0.0014 | 17.37 | 330 | 1.8153 | 0.7417 |
99
+ | 0.0025 | 17.89 | 340 | 1.8432 | 0.7450 |
100
+ | 0.0024 | 18.42 | 350 | 1.8597 | 0.7351 |
101
+ | 0.0022 | 18.95 | 360 | 1.8676 | 0.7384 |
102
+ | 0.0001 | 19.47 | 370 | 1.8602 | 0.7417 |
103
+ | 0.0032 | 20.0 | 380 | 1.8600 | 0.7450 |
104
+ | 0.0017 | 20.53 | 390 | 1.8576 | 0.7417 |
105
+ | 0.0022 | 21.05 | 400 | 1.8603 | 0.7417 |
106
+ | 0.0024 | 21.58 | 410 | 1.8649 | 0.7417 |
107
+ | 0.002 | 22.11 | 420 | 1.8704 | 0.7417 |
108
+ | 0.0008 | 22.63 | 430 | 1.8764 | 0.7417 |
109
+ | 0.0019 | 23.16 | 440 | 1.8914 | 0.7417 |
110
+ | 0.0015 | 23.68 | 450 | 1.9026 | 0.7384 |
111
+ | 0.0014 | 24.21 | 460 | 1.9146 | 0.7384 |
112
+ | 0.0017 | 24.74 | 470 | 1.9258 | 0.7384 |
113
+ | 0.0027 | 25.26 | 480 | 1.9280 | 0.7384 |
114
+ | 0.0027 | 25.79 | 490 | 1.9285 | 0.7384 |
115
+ | 0.001 | 26.32 | 500 | 1.9236 | 0.7384 |
116
+ | 0.0034 | 26.84 | 510 | 1.8905 | 0.7450 |
117
+ | 0.0013 | 27.37 | 520 | 1.8730 | 0.7417 |
118
+ | 0.0016 | 27.89 | 530 | 1.8687 | 0.7450 |
119
+ | 0.0007 | 28.42 | 540 | 1.8681 | 0.7483 |
120
+ | 0.0042 | 28.95 | 550 | 1.8683 | 0.7483 |
121
+ | 0.0009 | 29.47 | 560 | 1.8686 | 0.7483 |
122
+ | 0.0018 | 30.0 | 570 | 1.8687 | 0.7483 |
123
 
124
 
125
  ### Framework versions