Hugging Face's logo

davelotito
/
donut-base-sroie-metrics-combined-new

Image-Text-to-Text
Transformers
TensorBoard
Safetensors
vision-encoder-decoder
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
davelotito commited on
Commit
bca0c56
•
1 Parent(s): 55b3c3c

End of training

Browse files
Files changed (5) hide show
  1. README.md +16 -24
  2. model.safetensors +1 -1
  3. runs/May07_17-08-16_ip-172-16-119-166.ec2.internal/events.out.tfevents.1715101697.ip-172-16-119-166.ec2.internal.8723.0 +2 -2
  4. special_tokens_map.json +14 -0
  5. tokenizer_config.json +2 -0
README.md CHANGED
@@ -18,15 +18,15 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [naver-clova-ix/donut-base](https://huggingface.co/naver-clova-ix/donut-base) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.3171
22
- - Bleu: 0.0705
23
- - Precisions: [0.8333333333333334, 0.7599067599067599, 0.7123655913978495, 0.6761904761904762]
24
- - Brevity Penalty: 0.0948
25
- - Length Ratio: 0.2980
26
- - Translation Length: 486
27
- - Reference Length: 1631
28
- - Cer: 0.7492
29
- - Wer: 0.8169
30
 
31
  ## Model description
32
 
@@ -53,25 +53,17 @@ The following hyperparameters were used during training:
53
  - total_train_batch_size: 4
54
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
55
  - lr_scheduler_type: linear
56
- - num_epochs: 12
57
  - mixed_precision_training: Native AMP
58
 
59
  ### Training results
60
 
61
- | Training Loss | Epoch | Step | Validation Loss | Bleu | Precisions | Brevity Penalty | Length Ratio | Translation Length | Reference Length | Cer | Wer |
62
- |:-------------:|:-------:|:----:|:---------------:|:------:|:---------------------------------------------------------------------------------:|:---------------:|:------------:|:------------------:|:----------------:|:------:|:------:|
63
- | 6.4453 | 0.9960 | 126 | 2.4195 | 0.0 | [0.4214046822742475, 0.08130081300813008, 0.02040816326530612, 0.0] | 0.0116 | 0.1833 | 299 | 1631 | 0.9070 | 0.9677 |
64
- | 2.7428 | 2.0 | 253 | 1.0515 | 0.0210 | [0.6041666666666666, 0.3696808510638298, 0.2772585669781931, 0.20676691729323307] | 0.0623 | 0.2649 | 432 | 1631 | 0.8040 | 0.9235 |
65
- | 1.5566 | 2.9960 | 379 | 0.6386 | 0.0442 | [0.7029914529914529, 0.5693430656934306, 0.480225988700565, 0.4107744107744108] | 0.0833 | 0.2869 | 468 | 1631 | 0.7640 | 0.8789 |
66
- | 0.8362 | 4.0 | 506 | 0.4649 | 0.0646 | [0.7570281124497992, 0.6485260770975056, 0.5911458333333334, 0.5382262996941896] | 0.1028 | 0.3053 | 498 | 1631 | 0.7585 | 0.8472 |
67
- | 0.6682 | 4.9960 | 632 | 0.4224 | 0.0636 | [0.7540322580645161, 0.6514806378132119, 0.5916230366492147, 0.5323076923076923] | 0.1014 | 0.3041 | 496 | 1631 | 0.7607 | 0.8464 |
68
- | 0.5031 | 6.0 | 759 | 0.3836 | 0.0655 | [0.7857142857142857, 0.6928406466512702, 0.6382978723404256, 0.5893416927899686] | 0.0974 | 0.3004 | 490 | 1631 | 0.7561 | 0.8344 |
69
- | 0.446 | 6.9960 | 885 | 0.3603 | 0.0694 | [0.8179959100204499, 0.7384259259259259, 0.6853333333333333, 0.6383647798742138] | 0.0968 | 0.2998 | 489 | 1631 | 0.7526 | 0.8313 |
70
- | 0.3507 | 8.0 | 1012 | 0.3284 | 0.0700 | [0.8118609406952966, 0.7407407407407407, 0.696, 0.6540880503144654] | 0.0968 | 0.2998 | 489 | 1631 | 0.7534 | 0.8262 |
71
- | 0.2981 | 8.9960 | 1138 | 0.3234 | 0.0687 | [0.8340248962655602, 0.7623529411764706, 0.720108695652174, 0.6752411575562701] | 0.0922 | 0.2955 | 482 | 1631 | 0.7488 | 0.8198 |
72
- | 0.322 | 10.0 | 1265 | 0.3247 | 0.0705 | [0.8295687885010267, 0.7511627906976744, 0.710455764075067, 0.6708860759493671] | 0.0955 | 0.2986 | 487 | 1631 | 0.7518 | 0.8219 |
73
- | 0.2581 | 10.9960 | 1391 | 0.3154 | 0.0704 | [0.8429752066115702, 0.7681498829039812, 0.7243243243243244, 0.6869009584664537] | 0.0935 | 0.2968 | 484 | 1631 | 0.7485 | 0.8162 |
74
- | 0.2311 | 11.9526 | 1512 | 0.3171 | 0.0705 | [0.8333333333333334, 0.7599067599067599, 0.7123655913978495, 0.6761904761904762] | 0.0948 | 0.2980 | 486 | 1631 | 0.7492 | 0.8169 |
75
 
76
 
77
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [naver-clova-ix/donut-base](https://huggingface.co/naver-clova-ix/donut-base) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.8193
22
+ - Bleu: 0.0433
23
+ - Precisions: [0.6616702355460385, 0.5073170731707317, 0.43342776203966005, 0.36824324324324326]
24
+ - Brevity Penalty: 0.0899
25
+ - Length Ratio: 0.2933
26
+ - Translation Length: 467
27
+ - Reference Length: 1592
28
+ - Cer: 0.7585
29
+ - Wer: 0.8689
30
 
31
  ## Model description
32
 
 
53
  - total_train_batch_size: 4
54
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
55
  - lr_scheduler_type: linear
56
+ - num_epochs: 4
57
  - mixed_precision_training: Native AMP
58
 
59
  ### Training results
60
 
61
+ | Training Loss | Epoch | Step | Validation Loss | Bleu | Precisions | Brevity Penalty | Length Ratio | Translation Length | Reference Length | Cer | Wer |
62
+ |:-------------:|:------:|:----:|:---------------:|:------:|:-------------------------------------------------------------------------------------:|:---------------:|:------------:|:------------------:|:----------------:|:------:|:------:|
63
+ | 6.3552 | 0.9960 | 126 | 2.6182 | 0.0001 | [0.38207547169811323, 0.09876543209876543, 0.03508771929824561, 0.012195121951219513] | 0.0015 | 0.1332 | 212 | 1592 | 0.8972 | 0.9604 |
64
+ | 2.8839 | 2.0 | 253 | 1.3248 | 0.0102 | [0.5095238095238095, 0.20110192837465565, 0.11726384364820847, 0.06374501992031872] | 0.0614 | 0.2638 | 420 | 1592 | 0.8207 | 0.9242 |
65
+ | 1.8618 | 2.9960 | 379 | 0.9383 | 0.0231 | [0.5866983372921615, 0.41483516483516486, 0.32247557003257327, 0.248] | 0.0619 | 0.2644 | 421 | 1592 | 0.7806 | 0.8966 |
66
+ | 1.0999 | 3.9842 | 504 | 0.8193 | 0.0433 | [0.6616702355460385, 0.5073170731707317, 0.43342776203966005, 0.36824324324324326] | 0.0899 | 0.2933 | 467 | 1592 | 0.7585 | 0.8689 |
 
 
 
 
 
 
 
 
67
 
68
 
69
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f096b69b2082edcbb0dd2a7578670bcebb08196a5cd1c3a1ff7c403cad7cfecd
3
  size 809103512
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7111d034bfa2af48d658c6d16322d72d311aa2ff752fe419a704bc8dfc070cd9
3
  size 809103512
runs/May07_17-08-16_ip-172-16-119-166.ec2.internal/events.out.tfevents.1715101697.ip-172-16-119-166.ec2.internal.8723.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c9c63c2fba7aa9a5311e798513507f3dc9fdc7f26a77ed08a472c47e2a6fd3af
3
- size 11891
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be41efc81424efbc593ed05e102bdee53972bc58386e8ee83aa34c760458e8cc
3
+ size 13317
special_tokens_map.json CHANGED
@@ -63,6 +63,20 @@
63
  "rstrip": false,
64
  "single_word": false
65
  },
 
 
 
 
 
 
 
 
 
 
 
 
 
 
66
  {
67
  "content": "</s>",
68
  "lstrip": false,
 
63
  "rstrip": false,
64
  "single_word": false
65
  },
66
+ {
67
+ "content": "</s>",
68
+ "lstrip": false,
69
+ "normalized": false,
70
+ "rstrip": false,
71
+ "single_word": false
72
+ },
73
+ {
74
+ "content": "<s>",
75
+ "lstrip": false,
76
+ "normalized": false,
77
+ "rstrip": false,
78
+ "single_word": false
79
+ },
80
  {
81
  "content": "</s>",
82
  "lstrip": false,
tokenizer_config.json CHANGED
@@ -139,6 +139,8 @@
139
  "<s_address>",
140
  "</s_address>",
141
  "<s>",
 
 
142
  "</s>"
143
  ],
144
  "bos_token": "<s>",
 
139
  "<s_address>",
140
  "</s_address>",
141
  "<s>",
142
+ "</s>",
143
+ "<s>",
144
  "</s>"
145
  ],
146
  "bos_token": "<s>",