🍻 cheers
Browse files- README.md +308 -0
- all_results.json +8 -0
- config.json +32 -0
- model.safetensors +3 -0
- preprocessor_config.json +23 -0
- runs/Jan02_19-50-59_DESKTOP-7OEF4IN/events.out.tfevents.1735829573.DESKTOP-7OEF4IN.7400.0 +3 -0
- runs/Jan02_19-50-59_DESKTOP-7OEF4IN/events.out.tfevents.1735829804.DESKTOP-7OEF4IN.7400.1 +3 -0
- runs/Jan02_20-01-52_DESKTOP-7OEF4IN/events.out.tfevents.1735830128.DESKTOP-7OEF4IN.7400.2 +3 -0
- runs/Jan02_21-36-25_DESKTOP-7OEF4IN/events.out.tfevents.1735835805.DESKTOP-7OEF4IN.32903.0 +3 -0
- runs/Jan02_21-40-58_DESKTOP-7OEF4IN/events.out.tfevents.1735836061.DESKTOP-7OEF4IN.32903.1 +3 -0
- runs/Jan02_21-45-28_DESKTOP-7OEF4IN/events.out.tfevents.1735836338.DESKTOP-7OEF4IN.32903.2 +3 -0
- runs/Jan02_21-45-28_DESKTOP-7OEF4IN/events.out.tfevents.1735847392.DESKTOP-7OEF4IN.32903.3 +3 -0
- runs/Jan03_01-18-28_DESKTOP-7OEF4IN/events.out.tfevents.1735849122.DESKTOP-7OEF4IN.32903.4 +3 -0
- runs/Jan03_01-18-28_DESKTOP-7OEF4IN/events.out.tfevents.1735853688.DESKTOP-7OEF4IN.32903.5 +3 -0
- runs/Jan03_17-28-35_DESKTOP-7OEF4IN/events.out.tfevents.1735907343.DESKTOP-7OEF4IN.1436.0 +3 -0
- runs/Jan03_19-56-20_DESKTOP-7OEF4IN/events.out.tfevents.1735916186.DESKTOP-7OEF4IN.1436.1 +3 -0
- runs/Jan03_20-01-47_DESKTOP-7OEF4IN/events.out.tfevents.1735916522.DESKTOP-7OEF4IN.40853.0 +3 -0
- runs/Jan04_03-29-57_DESKTOP-7OEF4IN/events.out.tfevents.1735943426.DESKTOP-7OEF4IN.1936.0 +3 -0
- runs/Jan04_03-29-57_DESKTOP-7OEF4IN/events.out.tfevents.1735989840.DESKTOP-7OEF4IN.1936.1 +3 -0
- runs/Oct24_12-38-06_DESKTOP-7OEF4IN/events.out.tfevents.1729755627.DESKTOP-7OEF4IN.1323.0 +3 -0
- runs/Oct24_13-24-43_DESKTOP-7OEF4IN/events.out.tfevents.1729758333.DESKTOP-7OEF4IN.1323.1 +3 -0
- train_results.json +8 -0
- trainer_state.json +0 -0
- training_args.bin +3 -0
README.md
ADDED
@@ -0,0 +1,308 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
library_name: transformers
|
3 |
+
base_model: google/vit-base-patch16-224-in21k
|
4 |
+
tags:
|
5 |
+
- image-classification
|
6 |
+
- generated_from_trainer
|
7 |
+
datasets:
|
8 |
+
- imagefolder
|
9 |
+
metrics:
|
10 |
+
- accuracy
|
11 |
+
model-index:
|
12 |
+
- name: vit-base
|
13 |
+
results:
|
14 |
+
- task:
|
15 |
+
name: Image Classification
|
16 |
+
type: image-classification
|
17 |
+
dataset:
|
18 |
+
name: Ahmed-ibn-Harun/BrainHermorrhage
|
19 |
+
type: imagefolder
|
20 |
+
config: default
|
21 |
+
split: validation
|
22 |
+
args: default
|
23 |
+
metrics:
|
24 |
+
- name: Accuracy
|
25 |
+
type: accuracy
|
26 |
+
value: 0.8261405672009864
|
27 |
+
---
|
28 |
+
|
29 |
+
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
30 |
+
should probably proofread and complete it, then remove this comment. -->
|
31 |
+
|
32 |
+
# vit-base
|
33 |
+
|
34 |
+
This model is a fine-tuned version of [google/vit-base-patch16-224-in21k](https://huggingface.co/google/vit-base-patch16-224-in21k) on the Ahmed-ibn-Harun/BrainHermorrhage dataset.
|
35 |
+
It achieves the following results on the evaluation set:
|
36 |
+
- Loss: 0.3755
|
37 |
+
- Accuracy: 0.8261
|
38 |
+
- Sensitivity: 0.7221
|
39 |
+
- Specificity: 0.9289
|
40 |
+
- F1 Score: 0.8050
|
41 |
+
- Auc: 0.9162
|
42 |
+
|
43 |
+
## Model description
|
44 |
+
|
45 |
+
More information needed
|
46 |
+
|
47 |
+
## Intended uses & limitations
|
48 |
+
|
49 |
+
More information needed
|
50 |
+
|
51 |
+
## Training and evaluation data
|
52 |
+
|
53 |
+
More information needed
|
54 |
+
|
55 |
+
## Training procedure
|
56 |
+
|
57 |
+
### Training hyperparameters
|
58 |
+
|
59 |
+
The following hyperparameters were used during training:
|
60 |
+
- learning_rate: 0.0003
|
61 |
+
- train_batch_size: 16
|
62 |
+
- eval_batch_size: 8
|
63 |
+
- seed: 42
|
64 |
+
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
65 |
+
- lr_scheduler_type: linear
|
66 |
+
- num_epochs: 50
|
67 |
+
- mixed_precision_training: Native AMP
|
68 |
+
|
69 |
+
### Training results
|
70 |
+
|
71 |
+
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Sensitivity | Specificity | F1 Score | Auc |
|
72 |
+
|:-------------:|:-------:|:-----:|:---------------:|:--------:|:-----------:|:-----------:|:--------:|:------:|
|
73 |
+
| 0.3331 | 0.2188 | 100 | 0.4220 | 0.7891 | 0.6868 | 0.8902 | 0.7641 | 0.8947 |
|
74 |
+
| 0.4904 | 0.4376 | 200 | 0.4409 | 0.8038 | 0.7750 | 0.8324 | 0.7971 | 0.8931 |
|
75 |
+
| 0.4875 | 0.6565 | 300 | 0.5088 | 0.8162 | 0.9009 | 0.7324 | 0.8298 | 0.9057 |
|
76 |
+
| 0.4366 | 0.8753 | 400 | 0.3726 | 0.8314 | 0.7671 | 0.8951 | 0.8190 | 0.9190 |
|
77 |
+
| 0.4663 | 1.0941 | 500 | 0.4225 | 0.8157 | 0.8910 | 0.7412 | 0.8278 | 0.9201 |
|
78 |
+
| 0.2961 | 1.3129 | 600 | 0.3632 | 0.8339 | 0.7929 | 0.8745 | 0.8260 | 0.9244 |
|
79 |
+
| 0.3367 | 1.5317 | 700 | 0.4454 | 0.8117 | 0.8870 | 0.7373 | 0.8241 | 0.9083 |
|
80 |
+
| 0.4084 | 1.7505 | 800 | 0.5469 | 0.7408 | 0.9732 | 0.5108 | 0.7888 | 0.9068 |
|
81 |
+
| 0.3161 | 1.9694 | 900 | 0.3893 | 0.8329 | 0.8672 | 0.7990 | 0.8377 | 0.9282 |
|
82 |
+
| 0.4762 | 2.1882 | 1000 | 0.4871 | 0.7363 | 0.9633 | 0.5118 | 0.7842 | 0.8974 |
|
83 |
+
| 0.4006 | 2.4070 | 1100 | 0.4228 | 0.7900 | 0.9326 | 0.6490 | 0.8154 | 0.9257 |
|
84 |
+
| 0.4541 | 2.6258 | 1200 | 0.3389 | 0.8487 | 0.7641 | 0.9324 | 0.8340 | 0.9349 |
|
85 |
+
| 0.5397 | 2.8446 | 1300 | 0.4587 | 0.7565 | 0.9732 | 0.5422 | 0.7990 | 0.9244 |
|
86 |
+
| 0.2115 | 3.0635 | 1400 | 0.3976 | 0.8344 | 0.8196 | 0.8490 | 0.8312 | 0.9223 |
|
87 |
+
| 0.3588 | 3.2823 | 1500 | 0.3928 | 0.8211 | 0.8949 | 0.7480 | 0.8326 | 0.9208 |
|
88 |
+
| 0.3377 | 3.5011 | 1600 | 0.3943 | 0.8157 | 0.7483 | 0.8824 | 0.8015 | 0.9128 |
|
89 |
+
| 0.3385 | 3.7199 | 1700 | 0.3627 | 0.8428 | 0.8256 | 0.8598 | 0.8393 | 0.9247 |
|
90 |
+
| 0.3793 | 3.9387 | 1800 | 0.4015 | 0.8063 | 0.7592 | 0.8529 | 0.7958 | 0.9007 |
|
91 |
+
| 0.2774 | 4.1575 | 1900 | 0.4174 | 0.8186 | 0.8018 | 0.8353 | 0.8147 | 0.9090 |
|
92 |
+
| 0.2964 | 4.3764 | 2000 | 0.4120 | 0.8245 | 0.8940 | 0.7559 | 0.8352 | 0.9243 |
|
93 |
+
| 0.2042 | 4.5952 | 2100 | 0.3984 | 0.8383 | 0.8414 | 0.8353 | 0.8381 | 0.9214 |
|
94 |
+
| 0.2336 | 4.8140 | 2200 | 0.4263 | 0.8241 | 0.8722 | 0.7765 | 0.8314 | 0.9242 |
|
95 |
+
| 0.2292 | 5.0328 | 2300 | 0.4430 | 0.8339 | 0.8186 | 0.8490 | 0.8306 | 0.9241 |
|
96 |
+
| 0.265 | 5.2516 | 2400 | 0.4647 | 0.8314 | 0.7681 | 0.8941 | 0.8192 | 0.9204 |
|
97 |
+
| 0.2754 | 5.4705 | 2500 | 0.5476 | 0.7886 | 0.9128 | 0.6657 | 0.8111 | 0.9116 |
|
98 |
+
| 0.1859 | 5.6893 | 2600 | 0.4330 | 0.8324 | 0.8414 | 0.8235 | 0.8332 | 0.9218 |
|
99 |
+
| 0.1785 | 5.9081 | 2700 | 0.4180 | 0.8369 | 0.8375 | 0.8363 | 0.8362 | 0.9199 |
|
100 |
+
| 0.2057 | 6.1269 | 2800 | 0.4660 | 0.8319 | 0.8543 | 0.8098 | 0.8349 | 0.9158 |
|
101 |
+
| 0.289 | 6.3457 | 2900 | 0.4399 | 0.8186 | 0.8196 | 0.8176 | 0.8180 | 0.9086 |
|
102 |
+
| 0.1172 | 6.5646 | 3000 | 0.5597 | 0.8260 | 0.8474 | 0.8049 | 0.8289 | 0.9085 |
|
103 |
+
| 0.1758 | 6.7834 | 3100 | 0.4902 | 0.8201 | 0.8335 | 0.8069 | 0.8217 | 0.9078 |
|
104 |
+
| 0.2185 | 7.0022 | 3200 | 0.4738 | 0.8211 | 0.8295 | 0.8127 | 0.8218 | 0.9108 |
|
105 |
+
| 0.2255 | 7.2210 | 3300 | 0.5072 | 0.8098 | 0.8771 | 0.7431 | 0.8210 | 0.9082 |
|
106 |
+
| 0.213 | 7.4398 | 3400 | 0.4879 | 0.8379 | 0.7919 | 0.8833 | 0.8293 | 0.9126 |
|
107 |
+
| 0.1528 | 7.6586 | 3500 | 0.6054 | 0.8137 | 0.8276 | 0.8 | 0.8154 | 0.9057 |
|
108 |
+
| 0.1834 | 7.8775 | 3600 | 0.5653 | 0.8260 | 0.7532 | 0.8980 | 0.8115 | 0.9141 |
|
109 |
+
| 0.0812 | 8.0963 | 3700 | 0.6640 | 0.8176 | 0.7284 | 0.9059 | 0.7989 | 0.9068 |
|
110 |
+
| 0.1422 | 8.3151 | 3800 | 0.5916 | 0.8255 | 0.7721 | 0.8784 | 0.8149 | 0.9075 |
|
111 |
+
| 0.1116 | 8.5339 | 3900 | 0.5746 | 0.8226 | 0.8583 | 0.7873 | 0.8279 | 0.9057 |
|
112 |
+
| 0.1811 | 8.7527 | 4000 | 0.4679 | 0.8359 | 0.7869 | 0.8843 | 0.8267 | 0.9245 |
|
113 |
+
| 0.1949 | 8.9716 | 4100 | 0.4645 | 0.8201 | 0.7641 | 0.8755 | 0.8086 | 0.9048 |
|
114 |
+
| 0.036 | 9.1904 | 4200 | 0.6486 | 0.8349 | 0.7889 | 0.8804 | 0.8262 | 0.9116 |
|
115 |
+
| 0.1117 | 9.4092 | 4300 | 0.5656 | 0.8236 | 0.7433 | 0.9029 | 0.8073 | 0.9125 |
|
116 |
+
| 0.1101 | 9.6280 | 4400 | 0.5197 | 0.8285 | 0.8731 | 0.7843 | 0.8351 | 0.9226 |
|
117 |
+
| 0.2064 | 9.8468 | 4500 | 0.6169 | 0.8270 | 0.7641 | 0.8892 | 0.8146 | 0.9132 |
|
118 |
+
| 0.0647 | 10.0656 | 4600 | 0.5593 | 0.8255 | 0.7542 | 0.8961 | 0.8113 | 0.9122 |
|
119 |
+
| 0.0566 | 10.2845 | 4700 | 0.5822 | 0.8245 | 0.7384 | 0.9098 | 0.8072 | 0.9182 |
|
120 |
+
| 0.1324 | 10.5033 | 4800 | 0.5593 | 0.8319 | 0.7948 | 0.8686 | 0.8247 | 0.9146 |
|
121 |
+
| 0.0824 | 10.7221 | 4900 | 0.6553 | 0.8117 | 0.7037 | 0.9186 | 0.7880 | 0.9130 |
|
122 |
+
| 0.2134 | 10.9409 | 5000 | 0.5847 | 0.8334 | 0.8880 | 0.7794 | 0.8413 | 0.9271 |
|
123 |
+
| 0.0835 | 11.1597 | 5100 | 0.6585 | 0.8314 | 0.8008 | 0.8618 | 0.8253 | 0.9130 |
|
124 |
+
| 0.0936 | 11.3786 | 5200 | 0.8768 | 0.8191 | 0.7939 | 0.8441 | 0.8136 | 0.9062 |
|
125 |
+
| 0.0325 | 11.5974 | 5300 | 0.6502 | 0.8423 | 0.8315 | 0.8529 | 0.8398 | 0.9209 |
|
126 |
+
| 0.1054 | 11.8162 | 5400 | 0.5742 | 0.8354 | 0.8256 | 0.8451 | 0.833 | 0.9186 |
|
127 |
+
| 0.0157 | 12.0350 | 5500 | 0.7790 | 0.8324 | 0.8256 | 0.8392 | 0.8305 | 0.9150 |
|
128 |
+
| 0.0929 | 12.2538 | 5600 | 0.5779 | 0.8433 | 0.7978 | 0.8882 | 0.8351 | 0.9183 |
|
129 |
+
| 0.0553 | 12.4726 | 5700 | 0.6642 | 0.8369 | 0.8157 | 0.8578 | 0.8326 | 0.9154 |
|
130 |
+
| 0.1012 | 12.6915 | 5800 | 0.6882 | 0.8344 | 0.8494 | 0.8196 | 0.8361 | 0.9218 |
|
131 |
+
| 0.1292 | 12.9103 | 5900 | 0.6949 | 0.8310 | 0.7800 | 0.8814 | 0.8211 | 0.9114 |
|
132 |
+
| 0.103 | 13.1291 | 6000 | 0.7031 | 0.8398 | 0.8216 | 0.8578 | 0.8361 | 0.9162 |
|
133 |
+
| 0.0652 | 13.3479 | 6100 | 0.7927 | 0.8379 | 0.8176 | 0.8578 | 0.8338 | 0.9178 |
|
134 |
+
| 0.1194 | 13.5667 | 6200 | 0.7817 | 0.8211 | 0.7602 | 0.8814 | 0.8086 | 0.9125 |
|
135 |
+
| 0.2684 | 13.7856 | 6300 | 0.7446 | 0.8221 | 0.7017 | 0.9412 | 0.7968 | 0.9164 |
|
136 |
+
| 0.1194 | 14.0044 | 6400 | 0.7420 | 0.8334 | 0.8305 | 0.8363 | 0.8322 | 0.9152 |
|
137 |
+
| 0.0548 | 14.2232 | 6500 | 0.8545 | 0.8295 | 0.8543 | 0.8049 | 0.8329 | 0.8918 |
|
138 |
+
| 0.0681 | 14.4420 | 6600 | 0.8680 | 0.7915 | 0.6373 | 0.9441 | 0.7525 | 0.9094 |
|
139 |
+
| 0.0627 | 14.6608 | 6700 | 0.6181 | 0.8487 | 0.8028 | 0.8941 | 0.8407 | 0.9206 |
|
140 |
+
| 0.0565 | 14.8796 | 6800 | 0.7248 | 0.8241 | 0.8117 | 0.8363 | 0.8211 | 0.9108 |
|
141 |
+
| 0.0879 | 15.0985 | 6900 | 0.6817 | 0.8295 | 0.8484 | 0.8108 | 0.8319 | 0.9208 |
|
142 |
+
| 0.1235 | 15.3173 | 7000 | 0.7360 | 0.8344 | 0.8434 | 0.8255 | 0.8351 | 0.9143 |
|
143 |
+
| 0.1256 | 15.5361 | 7100 | 0.6166 | 0.8300 | 0.7839 | 0.8755 | 0.8210 | 0.9114 |
|
144 |
+
| 0.0353 | 15.7549 | 7200 | 0.7718 | 0.8339 | 0.8771 | 0.7912 | 0.8401 | 0.9231 |
|
145 |
+
| 0.0838 | 15.9737 | 7300 | 0.7930 | 0.8305 | 0.7919 | 0.8686 | 0.8229 | 0.8963 |
|
146 |
+
| 0.0345 | 16.1926 | 7400 | 0.9201 | 0.8231 | 0.7304 | 0.9147 | 0.8041 | 0.8816 |
|
147 |
+
| 0.0263 | 16.4114 | 7500 | 0.8642 | 0.8310 | 0.7433 | 0.9176 | 0.8139 | 0.9021 |
|
148 |
+
| 0.0471 | 16.6302 | 7600 | 0.8542 | 0.8324 | 0.7631 | 0.9010 | 0.8191 | 0.9031 |
|
149 |
+
| 0.0894 | 16.8490 | 7700 | 0.7756 | 0.8034 | 0.7116 | 0.8941 | 0.7826 | 0.8999 |
|
150 |
+
| 0.0649 | 17.0678 | 7800 | 0.7112 | 0.8344 | 0.8484 | 0.8206 | 0.8359 | 0.9077 |
|
151 |
+
| 0.0567 | 17.2867 | 7900 | 0.7433 | 0.8452 | 0.8394 | 0.8510 | 0.8436 | 0.9106 |
|
152 |
+
| 0.0229 | 17.5055 | 8000 | 0.8775 | 0.8255 | 0.7542 | 0.8961 | 0.8113 | 0.9017 |
|
153 |
+
| 0.009 | 17.7243 | 8100 | 0.8561 | 0.8349 | 0.7958 | 0.8735 | 0.8274 | 0.9062 |
|
154 |
+
| 0.0838 | 17.9431 | 8200 | 0.9441 | 0.8255 | 0.8771 | 0.7745 | 0.8333 | 0.9211 |
|
155 |
+
| 0.0958 | 18.1619 | 8300 | 0.9286 | 0.8255 | 0.7374 | 0.9127 | 0.8078 | 0.8961 |
|
156 |
+
| 0.0422 | 18.3807 | 8400 | 0.8053 | 0.8369 | 0.8186 | 0.8549 | 0.8331 | 0.9114 |
|
157 |
+
| 0.053 | 18.5996 | 8500 | 0.8440 | 0.8388 | 0.8067 | 0.8706 | 0.8327 | 0.8972 |
|
158 |
+
| 0.0462 | 18.8184 | 8600 | 0.7419 | 0.8221 | 0.8137 | 0.8304 | 0.8198 | 0.9108 |
|
159 |
+
| 0.0474 | 19.0372 | 8700 | 0.8702 | 0.8231 | 0.7849 | 0.8608 | 0.8152 | 0.8997 |
|
160 |
+
| 0.0257 | 19.2560 | 8800 | 0.8966 | 0.8157 | 0.7473 | 0.8833 | 0.8013 | 0.9049 |
|
161 |
+
| 0.0214 | 19.4748 | 8900 | 0.9787 | 0.8275 | 0.7839 | 0.8706 | 0.8188 | 0.8877 |
|
162 |
+
| 0.1409 | 19.6937 | 9000 | 0.8695 | 0.8379 | 0.7899 | 0.8853 | 0.8289 | 0.9084 |
|
163 |
+
| 0.0715 | 19.9125 | 9100 | 0.9500 | 0.8245 | 0.8028 | 0.8461 | 0.8198 | 0.8975 |
|
164 |
+
| 0.0331 | 20.1313 | 9200 | 0.9371 | 0.8334 | 0.8375 | 0.8294 | 0.8333 | 0.9042 |
|
165 |
+
| 0.0259 | 20.3501 | 9300 | 0.8587 | 0.8374 | 0.8127 | 0.8618 | 0.8325 | 0.9124 |
|
166 |
+
| 0.0093 | 20.5689 | 9400 | 0.7861 | 0.8393 | 0.8196 | 0.8588 | 0.8354 | 0.9182 |
|
167 |
+
| 0.0103 | 20.7877 | 9500 | 0.7921 | 0.8359 | 0.7800 | 0.8912 | 0.8254 | 0.9119 |
|
168 |
+
| 0.1187 | 21.0066 | 9600 | 0.7618 | 0.8260 | 0.7512 | 0.9 | 0.8111 | 0.9166 |
|
169 |
+
| 0.0024 | 21.2254 | 9700 | 0.9334 | 0.8319 | 0.8632 | 0.8010 | 0.8363 | 0.9123 |
|
170 |
+
| 0.0993 | 21.4442 | 9800 | 0.8067 | 0.8310 | 0.8682 | 0.7941 | 0.8363 | 0.9177 |
|
171 |
+
| 0.145 | 21.6630 | 9900 | 0.7816 | 0.8324 | 0.7770 | 0.8873 | 0.8218 | 0.9108 |
|
172 |
+
| 0.054 | 21.8818 | 10000 | 0.8371 | 0.8413 | 0.8523 | 0.8304 | 0.8423 | 0.9190 |
|
173 |
+
| 0.0446 | 22.1007 | 10100 | 0.8001 | 0.8354 | 0.7899 | 0.8804 | 0.8268 | 0.9084 |
|
174 |
+
| 0.1218 | 22.3195 | 10200 | 0.8164 | 0.8364 | 0.7701 | 0.9020 | 0.8240 | 0.9078 |
|
175 |
+
| 0.032 | 22.5383 | 10300 | 0.8353 | 0.8359 | 0.8256 | 0.8461 | 0.8334 | 0.9157 |
|
176 |
+
| 0.0804 | 22.7571 | 10400 | 0.8301 | 0.8314 | 0.7859 | 0.8765 | 0.8226 | 0.9149 |
|
177 |
+
| 0.0982 | 22.9759 | 10500 | 0.8366 | 0.8339 | 0.8305 | 0.8373 | 0.8326 | 0.9160 |
|
178 |
+
| 0.0153 | 23.1947 | 10600 | 0.8395 | 0.8295 | 0.7948 | 0.8637 | 0.8226 | 0.9150 |
|
179 |
+
| 0.0647 | 23.4136 | 10700 | 0.8342 | 0.8364 | 0.8662 | 0.8069 | 0.8404 | 0.9230 |
|
180 |
+
| 0.0906 | 23.6324 | 10800 | 0.8414 | 0.8078 | 0.8900 | 0.7265 | 0.8216 | 0.9166 |
|
181 |
+
| 0.0071 | 23.8512 | 10900 | 0.8552 | 0.8354 | 0.7889 | 0.8814 | 0.8266 | 0.9053 |
|
182 |
+
| 0.0254 | 24.0700 | 11000 | 0.8612 | 0.8428 | 0.7830 | 0.9020 | 0.8320 | 0.9009 |
|
183 |
+
| 0.0265 | 24.2888 | 11100 | 1.0379 | 0.8245 | 0.7195 | 0.9284 | 0.8031 | 0.8937 |
|
184 |
+
| 0.048 | 24.5077 | 11200 | 1.0143 | 0.8285 | 0.7611 | 0.8951 | 0.8153 | 0.8942 |
|
185 |
+
| 0.0005 | 24.7265 | 11300 | 0.9883 | 0.8310 | 0.8077 | 0.8539 | 0.8262 | 0.9024 |
|
186 |
+
| 0.1702 | 24.9453 | 11400 | 1.0282 | 0.8339 | 0.7512 | 0.9157 | 0.8181 | 0.9078 |
|
187 |
+
| 0.0006 | 25.1641 | 11500 | 0.9612 | 0.8448 | 0.8712 | 0.8186 | 0.8480 | 0.9151 |
|
188 |
+
| 0.0425 | 25.3829 | 11600 | 1.0040 | 0.8438 | 0.8612 | 0.8265 | 0.8457 | 0.9143 |
|
189 |
+
| 0.0006 | 25.6018 | 11700 | 0.9840 | 0.8305 | 0.7790 | 0.8814 | 0.8205 | 0.9117 |
|
190 |
+
| 0.0029 | 25.8206 | 11800 | 1.0850 | 0.8295 | 0.7294 | 0.9284 | 0.8097 | 0.9039 |
|
191 |
+
| 0.0776 | 26.0394 | 11900 | 0.9524 | 0.8334 | 0.8335 | 0.8333 | 0.8327 | 0.9119 |
|
192 |
+
| 0.0543 | 26.2582 | 12000 | 0.9541 | 0.8329 | 0.7572 | 0.9078 | 0.8184 | 0.9097 |
|
193 |
+
| 0.0018 | 26.4770 | 12100 | 0.8137 | 0.8393 | 0.8712 | 0.8078 | 0.8436 | 0.9225 |
|
194 |
+
| 0.0512 | 26.6958 | 12200 | 1.0741 | 0.8176 | 0.8712 | 0.7647 | 0.8261 | 0.8886 |
|
195 |
+
| 0.0008 | 26.9147 | 12300 | 1.0294 | 0.8393 | 0.8484 | 0.8304 | 0.8400 | 0.8987 |
|
196 |
+
| 0.043 | 27.1335 | 12400 | 0.9720 | 0.8334 | 0.8682 | 0.7990 | 0.8383 | 0.9135 |
|
197 |
+
| 0.0013 | 27.3523 | 12500 | 0.9571 | 0.8374 | 0.7800 | 0.8941 | 0.8267 | 0.9120 |
|
198 |
+
| 0.0163 | 27.5711 | 12600 | 0.9475 | 0.8305 | 0.8167 | 0.8441 | 0.8273 | 0.9102 |
|
199 |
+
| 0.0034 | 27.7899 | 12700 | 0.8116 | 0.8403 | 0.8365 | 0.8441 | 0.8390 | 0.9183 |
|
200 |
+
| 0.0014 | 28.0088 | 12800 | 0.9375 | 0.8305 | 0.8285 | 0.8324 | 0.8294 | 0.9139 |
|
201 |
+
| 0.0008 | 28.2276 | 12900 | 1.0335 | 0.8314 | 0.7602 | 0.9020 | 0.8177 | 0.9072 |
|
202 |
+
| 0.0497 | 28.4464 | 13000 | 1.0562 | 0.8285 | 0.7592 | 0.8971 | 0.8149 | 0.9039 |
|
203 |
+
| 0.0319 | 28.6652 | 13100 | 0.7997 | 0.8364 | 0.8444 | 0.8284 | 0.8369 | 0.9167 |
|
204 |
+
| 0.0932 | 28.8840 | 13200 | 0.8591 | 0.8167 | 0.8474 | 0.7863 | 0.8213 | 0.9142 |
|
205 |
+
| 0.0007 | 29.1028 | 13300 | 0.8555 | 0.8379 | 0.8246 | 0.8510 | 0.8349 | 0.9196 |
|
206 |
+
| 0.0025 | 29.3217 | 13400 | 0.9062 | 0.8359 | 0.8236 | 0.8480 | 0.8331 | 0.9147 |
|
207 |
+
| 0.0117 | 29.5405 | 13500 | 0.8089 | 0.8339 | 0.8345 | 0.8333 | 0.8333 | 0.9181 |
|
208 |
+
| 0.0505 | 29.7593 | 13600 | 0.9048 | 0.8329 | 0.8404 | 0.8255 | 0.8334 | 0.9167 |
|
209 |
+
| 0.0484 | 29.9781 | 13700 | 1.0264 | 0.8265 | 0.8573 | 0.7961 | 0.8309 | 0.9133 |
|
210 |
+
| 0.0004 | 30.1969 | 13800 | 1.0712 | 0.8349 | 0.8087 | 0.8608 | 0.8297 | 0.9053 |
|
211 |
+
| 0.0157 | 30.4158 | 13900 | 1.0159 | 0.8236 | 0.8186 | 0.8284 | 0.8219 | 0.9062 |
|
212 |
+
| 0.0004 | 30.6346 | 14000 | 1.0367 | 0.8305 | 0.8196 | 0.8412 | 0.8278 | 0.9022 |
|
213 |
+
| 0.0003 | 30.8534 | 14100 | 0.9853 | 0.8314 | 0.8345 | 0.8284 | 0.8312 | 0.9123 |
|
214 |
+
| 0.0039 | 31.0722 | 14200 | 0.9839 | 0.8413 | 0.7869 | 0.8951 | 0.8314 | 0.9124 |
|
215 |
+
| 0.0505 | 31.2910 | 14300 | 1.0911 | 0.8339 | 0.8741 | 0.7941 | 0.8396 | 0.9033 |
|
216 |
+
| 0.0007 | 31.5098 | 14400 | 0.8740 | 0.8374 | 0.8246 | 0.85 | 0.8345 | 0.9208 |
|
217 |
+
| 0.0004 | 31.7287 | 14500 | 0.9801 | 0.8398 | 0.8295 | 0.85 | 0.8374 | 0.9208 |
|
218 |
+
| 0.0592 | 31.9475 | 14600 | 1.0447 | 0.8305 | 0.8404 | 0.8206 | 0.8314 | 0.9165 |
|
219 |
+
| 0.0003 | 32.1663 | 14700 | 1.1005 | 0.8245 | 0.8543 | 0.7951 | 0.8288 | 0.9129 |
|
220 |
+
| 0.0002 | 32.3851 | 14800 | 1.1025 | 0.8319 | 0.8176 | 0.8461 | 0.8287 | 0.9108 |
|
221 |
+
| 0.0428 | 32.6039 | 14900 | 1.0779 | 0.8310 | 0.8236 | 0.8382 | 0.8289 | 0.9096 |
|
222 |
+
| 0.049 | 32.8228 | 15000 | 0.9729 | 0.8408 | 0.8295 | 0.8520 | 0.8383 | 0.9208 |
|
223 |
+
| 0.0219 | 33.0416 | 15100 | 0.9851 | 0.8211 | 0.7661 | 0.8755 | 0.8098 | 0.9120 |
|
224 |
+
| 0.001 | 33.2604 | 15200 | 0.9834 | 0.8349 | 0.8256 | 0.8441 | 0.8326 | 0.9166 |
|
225 |
+
| 0.0009 | 33.4792 | 15300 | 1.0128 | 0.8270 | 0.7463 | 0.9069 | 0.8110 | 0.9130 |
|
226 |
+
| 0.0146 | 33.6980 | 15400 | 0.9835 | 0.8300 | 0.7790 | 0.8804 | 0.8200 | 0.9097 |
|
227 |
+
| 0.0184 | 33.9168 | 15500 | 0.8922 | 0.8290 | 0.8276 | 0.8304 | 0.8280 | 0.9183 |
|
228 |
+
| 0.0528 | 34.1357 | 15600 | 0.9727 | 0.8398 | 0.7899 | 0.8892 | 0.8306 | 0.9107 |
|
229 |
+
| 0.0018 | 34.3545 | 15700 | 1.0313 | 0.8413 | 0.8196 | 0.8627 | 0.8370 | 0.9065 |
|
230 |
+
| 0.0002 | 34.5733 | 15800 | 1.0882 | 0.8374 | 0.7978 | 0.8765 | 0.8299 | 0.9065 |
|
231 |
+
| 0.0002 | 34.7921 | 15900 | 1.0866 | 0.8379 | 0.8236 | 0.8520 | 0.8348 | 0.9045 |
|
232 |
+
| 0.0865 | 35.0109 | 16000 | 1.0595 | 0.8300 | 0.7602 | 0.8990 | 0.8164 | 0.8971 |
|
233 |
+
| 0.0004 | 35.2298 | 16100 | 1.0287 | 0.8344 | 0.7988 | 0.8696 | 0.8275 | 0.9041 |
|
234 |
+
| 0.0003 | 35.4486 | 16200 | 1.0652 | 0.8305 | 0.8176 | 0.8431 | 0.8275 | 0.8877 |
|
235 |
+
| 0.0006 | 35.6674 | 16300 | 1.0627 | 0.8270 | 0.7988 | 0.8549 | 0.8212 | 0.8848 |
|
236 |
+
| 0.0003 | 35.8862 | 16400 | 1.1173 | 0.8339 | 0.7780 | 0.8892 | 0.8233 | 0.8843 |
|
237 |
+
| 0.0002 | 36.1050 | 16500 | 1.1114 | 0.8379 | 0.8048 | 0.8706 | 0.8315 | 0.8948 |
|
238 |
+
| 0.0002 | 36.3239 | 16600 | 1.1165 | 0.8379 | 0.8137 | 0.8618 | 0.8331 | 0.8968 |
|
239 |
+
| 0.0004 | 36.5427 | 16700 | 1.1693 | 0.8369 | 0.8147 | 0.8588 | 0.8324 | 0.8918 |
|
240 |
+
| 0.0002 | 36.7615 | 16800 | 1.1609 | 0.8364 | 0.8325 | 0.8402 | 0.8350 | 0.8856 |
|
241 |
+
| 0.0007 | 36.9803 | 16900 | 1.1993 | 0.8334 | 0.8107 | 0.8559 | 0.8288 | 0.8935 |
|
242 |
+
| 0.0002 | 37.1991 | 17000 | 1.0206 | 0.8374 | 0.8652 | 0.8098 | 0.8410 | 0.9128 |
|
243 |
+
| 0.0024 | 37.4179 | 17100 | 0.9984 | 0.8359 | 0.7899 | 0.8814 | 0.8272 | 0.9094 |
|
244 |
+
| 0.0005 | 37.6368 | 17200 | 1.1162 | 0.8388 | 0.7671 | 0.9098 | 0.8256 | 0.8987 |
|
245 |
+
| 0.0008 | 37.8556 | 17300 | 0.9434 | 0.8433 | 0.8414 | 0.8451 | 0.8423 | 0.9146 |
|
246 |
+
| 0.0003 | 38.0744 | 17400 | 0.9508 | 0.8457 | 0.8523 | 0.8392 | 0.8460 | 0.9200 |
|
247 |
+
| 0.0003 | 38.2932 | 17500 | 1.0299 | 0.8379 | 0.8345 | 0.8412 | 0.8366 | 0.9183 |
|
248 |
+
| 0.0002 | 38.5120 | 17600 | 1.0518 | 0.8438 | 0.8325 | 0.8549 | 0.8413 | 0.9178 |
|
249 |
+
| 0.0015 | 38.7309 | 17700 | 1.0205 | 0.8472 | 0.8464 | 0.8480 | 0.8464 | 0.9210 |
|
250 |
+
| 0.0188 | 38.9497 | 17800 | 1.0644 | 0.8438 | 0.7968 | 0.8902 | 0.8353 | 0.9183 |
|
251 |
+
| 0.0002 | 39.1685 | 17900 | 1.0497 | 0.8443 | 0.8266 | 0.8618 | 0.8407 | 0.9220 |
|
252 |
+
| 0.0003 | 39.3873 | 18000 | 1.0802 | 0.8443 | 0.8236 | 0.8647 | 0.8402 | 0.9210 |
|
253 |
+
| 0.0002 | 39.6061 | 18100 | 1.1465 | 0.8393 | 0.7958 | 0.8824 | 0.8313 | 0.9186 |
|
254 |
+
| 0.0002 | 39.8249 | 18200 | 1.0551 | 0.8467 | 0.8147 | 0.8784 | 0.8409 | 0.9185 |
|
255 |
+
| 0.0002 | 40.0438 | 18300 | 1.0791 | 0.8467 | 0.8147 | 0.8784 | 0.8409 | 0.9171 |
|
256 |
+
| 0.0002 | 40.2626 | 18400 | 1.0902 | 0.8487 | 0.8176 | 0.8794 | 0.8431 | 0.9175 |
|
257 |
+
| 0.0002 | 40.4814 | 18500 | 1.1028 | 0.8487 | 0.8176 | 0.8794 | 0.8431 | 0.9175 |
|
258 |
+
| 0.0001 | 40.7002 | 18600 | 1.1156 | 0.8487 | 0.8176 | 0.8794 | 0.8431 | 0.9165 |
|
259 |
+
| 0.0001 | 40.9190 | 18700 | 1.1266 | 0.8487 | 0.8176 | 0.8794 | 0.8431 | 0.9168 |
|
260 |
+
| 0.0002 | 41.1379 | 18800 | 1.0527 | 0.8472 | 0.8246 | 0.8696 | 0.8430 | 0.9186 |
|
261 |
+
| 0.0002 | 41.3567 | 18900 | 1.0758 | 0.8477 | 0.8226 | 0.8725 | 0.8431 | 0.9190 |
|
262 |
+
| 0.0001 | 41.5755 | 19000 | 1.0940 | 0.8492 | 0.8216 | 0.8765 | 0.8442 | 0.9199 |
|
263 |
+
| 0.0268 | 41.7943 | 19100 | 0.9887 | 0.8374 | 0.8494 | 0.8255 | 0.8386 | 0.9196 |
|
264 |
+
| 0.002 | 42.0131 | 19200 | 1.0890 | 0.8354 | 0.7730 | 0.8971 | 0.8237 | 0.9172 |
|
265 |
+
| 0.0002 | 42.2319 | 19300 | 1.0668 | 0.8418 | 0.8147 | 0.8686 | 0.8366 | 0.9154 |
|
266 |
+
| 0.0001 | 42.4508 | 19400 | 1.1239 | 0.8383 | 0.7899 | 0.8863 | 0.8293 | 0.9150 |
|
267 |
+
| 0.0001 | 42.6696 | 19500 | 1.1372 | 0.8364 | 0.8285 | 0.8441 | 0.8343 | 0.9084 |
|
268 |
+
| 0.0001 | 42.8884 | 19600 | 1.1153 | 0.8393 | 0.7869 | 0.8912 | 0.8297 | 0.9200 |
|
269 |
+
| 0.0001 | 43.1072 | 19700 | 1.1482 | 0.8413 | 0.7790 | 0.9029 | 0.8300 | 0.9184 |
|
270 |
+
| 0.0001 | 43.3260 | 19800 | 1.1535 | 0.8388 | 0.7859 | 0.8912 | 0.8291 | 0.9180 |
|
271 |
+
| 0.0001 | 43.5449 | 19900 | 1.1138 | 0.8393 | 0.8236 | 0.8549 | 0.8360 | 0.9188 |
|
272 |
+
| 0.0001 | 43.7637 | 20000 | 1.1321 | 0.8393 | 0.8186 | 0.8598 | 0.8352 | 0.9176 |
|
273 |
+
| 0.0001 | 43.9825 | 20100 | 1.1473 | 0.8403 | 0.8147 | 0.8657 | 0.8354 | 0.9163 |
|
274 |
+
| 0.0001 | 44.2013 | 20200 | 1.1550 | 0.8413 | 0.8137 | 0.8686 | 0.8360 | 0.9154 |
|
275 |
+
| 0.0001 | 44.4201 | 20300 | 1.1630 | 0.8428 | 0.8127 | 0.8725 | 0.8372 | 0.9143 |
|
276 |
+
| 0.0001 | 44.6389 | 20400 | 1.1718 | 0.8428 | 0.8117 | 0.8735 | 0.8370 | 0.9133 |
|
277 |
+
| 0.0001 | 44.8578 | 20500 | 1.1793 | 0.8428 | 0.8117 | 0.8735 | 0.8370 | 0.9129 |
|
278 |
+
| 0.0001 | 45.0766 | 20600 | 1.1869 | 0.8418 | 0.8097 | 0.8735 | 0.8358 | 0.9121 |
|
279 |
+
| 0.0001 | 45.2954 | 20700 | 1.1931 | 0.8413 | 0.8087 | 0.8735 | 0.8352 | 0.9115 |
|
280 |
+
| 0.0001 | 45.5142 | 20800 | 1.1990 | 0.8418 | 0.8097 | 0.8735 | 0.8358 | 0.9103 |
|
281 |
+
| 0.0001 | 45.7330 | 20900 | 1.2056 | 0.8418 | 0.8087 | 0.8745 | 0.8356 | 0.9097 |
|
282 |
+
| 0.0001 | 45.9519 | 21000 | 1.2116 | 0.8423 | 0.8087 | 0.8755 | 0.8361 | 0.9092 |
|
283 |
+
| 0.0001 | 46.1707 | 21100 | 1.2176 | 0.8428 | 0.8087 | 0.8765 | 0.8365 | 0.9090 |
|
284 |
+
| 0.0001 | 46.3895 | 21200 | 1.2233 | 0.8433 | 0.8087 | 0.8775 | 0.8369 | 0.9082 |
|
285 |
+
| 0.0001 | 46.6083 | 21300 | 1.2281 | 0.8433 | 0.8087 | 0.8775 | 0.8369 | 0.9079 |
|
286 |
+
| 0.0001 | 46.8271 | 21400 | 1.2322 | 0.8433 | 0.8087 | 0.8775 | 0.8369 | 0.9075 |
|
287 |
+
| 0.0001 | 47.0460 | 21500 | 1.2365 | 0.8433 | 0.8087 | 0.8775 | 0.8369 | 0.9075 |
|
288 |
+
| 0.0001 | 47.2648 | 21600 | 1.2402 | 0.8433 | 0.8087 | 0.8775 | 0.8369 | 0.9074 |
|
289 |
+
| 0.0001 | 47.4836 | 21700 | 1.2447 | 0.8433 | 0.8087 | 0.8775 | 0.8369 | 0.9060 |
|
290 |
+
| 0.0001 | 47.7024 | 21800 | 1.2484 | 0.8433 | 0.8087 | 0.8775 | 0.8369 | 0.9068 |
|
291 |
+
| 0.0001 | 47.9212 | 21900 | 1.2516 | 0.8433 | 0.8087 | 0.8775 | 0.8369 | 0.9064 |
|
292 |
+
| 0.0 | 48.1400 | 22000 | 1.2546 | 0.8433 | 0.8087 | 0.8775 | 0.8369 | 0.9068 |
|
293 |
+
| 0.0 | 48.3589 | 22100 | 1.2572 | 0.8433 | 0.8087 | 0.8775 | 0.8369 | 0.9062 |
|
294 |
+
| 0.0 | 48.5777 | 22200 | 1.2603 | 0.8433 | 0.8087 | 0.8775 | 0.8369 | 0.9058 |
|
295 |
+
| 0.0 | 48.7965 | 22300 | 1.2628 | 0.8438 | 0.8087 | 0.8784 | 0.8374 | 0.9057 |
|
296 |
+
| 0.0 | 49.0153 | 22400 | 1.2647 | 0.8438 | 0.8087 | 0.8784 | 0.8374 | 0.9053 |
|
297 |
+
| 0.0 | 49.2341 | 22500 | 1.2663 | 0.8438 | 0.8087 | 0.8784 | 0.8374 | 0.9055 |
|
298 |
+
| 0.0 | 49.4530 | 22600 | 1.2679 | 0.8438 | 0.8087 | 0.8784 | 0.8374 | 0.9058 |
|
299 |
+
| 0.0 | 49.6718 | 22700 | 1.2687 | 0.8438 | 0.8087 | 0.8784 | 0.8374 | 0.9057 |
|
300 |
+
| 0.0 | 49.8906 | 22800 | 1.2691 | 0.8438 | 0.8087 | 0.8784 | 0.8374 | 0.9061 |
|
301 |
+
|
302 |
+
|
303 |
+
### Framework versions
|
304 |
+
|
305 |
+
- Transformers 4.47.1
|
306 |
+
- Pytorch 2.5.1+cu121
|
307 |
+
- Datasets 2.20.0
|
308 |
+
- Tokenizers 0.21.0
|
all_results.json
ADDED
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"epoch": 50.0,
|
3 |
+
"total_flos": 2.827682701036462e+19,
|
4 |
+
"train_loss": 0.07304404771530132,
|
5 |
+
"train_runtime": 20516.3391,
|
6 |
+
"train_samples_per_second": 17.786,
|
7 |
+
"train_steps_per_second": 1.114
|
8 |
+
}
|
config.json
ADDED
@@ -0,0 +1,32 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"_name_or_path": "../models/vit-base-normalized",
|
3 |
+
"architectures": [
|
4 |
+
"ViTForImageClassification"
|
5 |
+
],
|
6 |
+
"attention_probs_dropout_prob": 0.0,
|
7 |
+
"encoder_stride": 16,
|
8 |
+
"hidden_act": "gelu",
|
9 |
+
"hidden_dropout_prob": 0.0,
|
10 |
+
"hidden_size": 768,
|
11 |
+
"id2label": {
|
12 |
+
"0": "0_no_hermorrhage",
|
13 |
+
"1": "1_hermorrhage"
|
14 |
+
},
|
15 |
+
"image_size": 224,
|
16 |
+
"initializer_range": 0.02,
|
17 |
+
"intermediate_size": 3072,
|
18 |
+
"label2id": {
|
19 |
+
"0_no_hermorrhage": "0",
|
20 |
+
"1_hermorrhage": "1"
|
21 |
+
},
|
22 |
+
"layer_norm_eps": 1e-12,
|
23 |
+
"model_type": "vit",
|
24 |
+
"num_attention_heads": 12,
|
25 |
+
"num_channels": 3,
|
26 |
+
"num_hidden_layers": 12,
|
27 |
+
"patch_size": 16,
|
28 |
+
"problem_type": "single_label_classification",
|
29 |
+
"qkv_bias": true,
|
30 |
+
"torch_dtype": "float32",
|
31 |
+
"transformers_version": "4.47.1"
|
32 |
+
}
|
model.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8dd3800c413438310192cf6edbc2eb8ee739251d78093b7a930d405743c68caa
|
3 |
+
size 343223968
|
preprocessor_config.json
ADDED
@@ -0,0 +1,23 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"do_convert_rgb": null,
|
3 |
+
"do_normalize": false,
|
4 |
+
"do_rescale": true,
|
5 |
+
"do_resize": true,
|
6 |
+
"image_mean": [
|
7 |
+
0.5,
|
8 |
+
0.5,
|
9 |
+
0.5
|
10 |
+
],
|
11 |
+
"image_processor_type": "ViTFeatureExtractor",
|
12 |
+
"image_std": [
|
13 |
+
0.5,
|
14 |
+
0.5,
|
15 |
+
0.5
|
16 |
+
],
|
17 |
+
"resample": 2,
|
18 |
+
"rescale_factor": 0.00392156862745098,
|
19 |
+
"size": {
|
20 |
+
"height": 224,
|
21 |
+
"width": 224
|
22 |
+
}
|
23 |
+
}
|
runs/Jan02_19-50-59_DESKTOP-7OEF4IN/events.out.tfevents.1735829573.DESKTOP-7OEF4IN.7400.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:72fa0bc4cc98c9eb848e81730c2f004269ea7abca1ff314158a0e124c604d3ed
|
3 |
+
size 5141
|
runs/Jan02_19-50-59_DESKTOP-7OEF4IN/events.out.tfevents.1735829804.DESKTOP-7OEF4IN.7400.1
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c319aeaee92d63b09c8f41cb9631d04f1a178a9fb2ea40e481c7460463bb289d
|
3 |
+
size 5141
|
runs/Jan02_20-01-52_DESKTOP-7OEF4IN/events.out.tfevents.1735830128.DESKTOP-7OEF4IN.7400.2
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:da8ea6b5b41f600a80fd9aeb64f63d52ed10baa56309fa0961e4b795e4832402
|
3 |
+
size 5144
|
runs/Jan02_21-36-25_DESKTOP-7OEF4IN/events.out.tfevents.1735835805.DESKTOP-7OEF4IN.32903.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8e2af7c76e84ffd4355998874595aa780332bd540aef4e798dc5e8c34d7e1e61
|
3 |
+
size 7736
|
runs/Jan02_21-40-58_DESKTOP-7OEF4IN/events.out.tfevents.1735836061.DESKTOP-7OEF4IN.32903.1
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c941c2f58f8ad029e99eacdc97e7d0bdae8e069598b91c16bda9c68b372de2a7
|
3 |
+
size 7709
|
runs/Jan02_21-45-28_DESKTOP-7OEF4IN/events.out.tfevents.1735836338.DESKTOP-7OEF4IN.32903.2
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:312b42b8c3fc378c6fff80ce00fb2a023606c823a47c491c2319bbb000ea4432
|
3 |
+
size 125820
|
runs/Jan02_21-45-28_DESKTOP-7OEF4IN/events.out.tfevents.1735847392.DESKTOP-7OEF4IN.32903.3
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f06a3fb41dd8ae47f2a9bb2a9d2d043040e7dfc0ba06181e9f84851f262fa696
|
3 |
+
size 1152
|
runs/Jan03_01-18-28_DESKTOP-7OEF4IN/events.out.tfevents.1735849122.DESKTOP-7OEF4IN.32903.4
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0c5075eade2b90a9f826c30be26b798dc7141151af5ea47acea3aee2400a1aae
|
3 |
+
size 125820
|
runs/Jan03_01-18-28_DESKTOP-7OEF4IN/events.out.tfevents.1735853688.DESKTOP-7OEF4IN.32903.5
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:55cd15e97588dab4320d8e0920a763e5329c9a7101d9d0df5bfa2ff978b2c1ca
|
3 |
+
size 1152
|
runs/Jan03_17-28-35_DESKTOP-7OEF4IN/events.out.tfevents.1735907343.DESKTOP-7OEF4IN.1436.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:087c2aba2f00adb8329e95c0d19c1635cb3e1aaec24412f49b196855efdb52c1
|
3 |
+
size 125820
|
runs/Jan03_19-56-20_DESKTOP-7OEF4IN/events.out.tfevents.1735916186.DESKTOP-7OEF4IN.1436.1
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a1bea8313b2f4d9853ae2c679d4a8429eac9a6203821d9a8ffd58bddb7a660de
|
3 |
+
size 6153
|
runs/Jan03_20-01-47_DESKTOP-7OEF4IN/events.out.tfevents.1735916522.DESKTOP-7OEF4IN.40853.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1597321ce54f7703f9a28eb3ef6053b7ceb0d58d4e3d992b603bff4cb73f4115
|
3 |
+
size 333763
|
runs/Jan04_03-29-57_DESKTOP-7OEF4IN/events.out.tfevents.1735943426.DESKTOP-7OEF4IN.1936.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:55c9a51f3eb968a37214ddcb7ec0b2e2356d37177add81aee4adb43ce4ed23a9
|
3 |
+
size 612128
|
runs/Jan04_03-29-57_DESKTOP-7OEF4IN/events.out.tfevents.1735989840.DESKTOP-7OEF4IN.1936.1
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a856a9d361a9f7f2a0f18784a37b02f23a6ee01ca7de58640412e5cc776802e2
|
3 |
+
size 1714
|
runs/Oct24_12-38-06_DESKTOP-7OEF4IN/events.out.tfevents.1729755627.DESKTOP-7OEF4IN.1323.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:29b818ab31e0d6f34faeabee60c156db7da33e4261c6d02a073064a4e3e85b26
|
3 |
+
size 1174
|
runs/Oct24_13-24-43_DESKTOP-7OEF4IN/events.out.tfevents.1729758333.DESKTOP-7OEF4IN.1323.1
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6790febdd393f3d77d198d8f6a3ff9ea96dbc3f05d8cbd3b913aaa09eeb06d06
|
3 |
+
size 543
|
train_results.json
ADDED
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"epoch": 50.0,
|
3 |
+
"total_flos": 2.827682701036462e+19,
|
4 |
+
"train_loss": 0.07304404771530132,
|
5 |
+
"train_runtime": 20516.3391,
|
6 |
+
"train_samples_per_second": 17.786,
|
7 |
+
"train_steps_per_second": 1.114
|
8 |
+
}
|
trainer_state.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
training_args.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:364d41a24e84fd8f22f6ffa4a9110a25c68fa527734899b2b95536a96a8b3546
|
3 |
+
size 5368
|