End of training

README.md

@@ -0,0 +1,94 @@
+---
+library_name: transformers
+language:
+- fr
+base_model: microsoft/trocr-base-handwritten
+tags:
+- generated_from_trainer
+metrics:
+- wer
+model-index:
+- name: TrOCR Small (Finetuned on French)
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# TrOCR Small (Finetuned on French)
+
+This model is a fine-tuned version of [microsoft/trocr-base-handwritten](https://huggingface.co/microsoft/trocr-base-handwritten) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.0871
+- Model Preparation Time: 0.0066
+- Cer: 0.0134
+- Wer: 0.0350
+- Ratio: 97.4287
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- training_steps: 12000
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch  | Step  | Validation Loss | Model Preparation Time | Cer    | Wer    | Ratio   |
+|:-------------:|:------:|:-----:|:---------------:|:----------------------:|:------:|:------:|:-------:|
+| 1.359         | 0.0333 | 400   | 1.0638          | 0.0066                 | 0.1715 | 0.3841 | 89.6898 |
+| 1.1123        | 0.0667 | 800   | 1.2707          | 0.0066                 | 0.1715 | 0.4437 | 89.7413 |
+| 0.872         | 0.1    | 1200  | 0.9230          | 0.0066                 | 0.1305 | 0.3576 | 91.0810 |
+| 0.6831        | 0.1333 | 1600  | 0.7046          | 0.0066                 | 0.1195 | 0.2848 | 92.7617 |
+| 0.6659        | 0.1667 | 2000  | 0.5952          | 0.0066                 | 0.0841 | 0.2450 | 94.7742 |
+| 0.612         | 0.2    | 2400  | 0.5830          | 0.0066                 | 0.1029 | 0.2517 | 93.2609 |
+| 0.4865        | 0.2333 | 2800  | 0.5312          | 0.0066                 | 0.0973 | 0.2318 | 94.4422 |
+| 0.4922        | 0.2667 | 3200  | 0.5842          | 0.0066                 | 0.0918 | 0.1987 | 95.5454 |
+| 0.4152        | 0.3    | 3600  | 0.4215          | 0.0066                 | 0.0664 | 0.1921 | 95.9747 |
+| 0.3648        | 0.3333 | 4000  | 0.4264          | 0.0066                 | 0.0608 | 0.1722 | 96.4262 |
+| 0.3272        | 0.3667 | 4400  | 0.5209          | 0.0066                 | 0.0653 | 0.1921 | 95.3742 |
+| 0.3172        | 0.4    | 4800  | 0.4229          | 0.0066                 | 0.0531 | 0.1788 | 95.8131 |
+| 0.2672        | 0.4333 | 5200  | 0.4071          | 0.0066                 | 0.0586 | 0.1921 | 96.0787 |
+| 0.2747        | 0.4667 | 5600  | 0.3494          | 0.0066                 | 0.0586 | 0.1656 | 96.2269 |
+| 0.2576        | 0.5    | 6000  | 0.3687          | 0.0066                 | 0.0642 | 0.1523 | 96.6562 |
+| 0.2138        | 0.5333 | 6400  | 0.3945          | 0.0066                 | 0.0564 | 0.1391 | 96.8775 |
+| 0.2197        | 0.5667 | 6800  | 0.3698          | 0.0066                 | 0.0420 | 0.1391 | 97.3293 |
+| 0.1908        | 1.0141 | 7200  | 0.3288          | 0.0066                 | 0.0420 | 0.1126 | 97.6500 |
+| 0.145         | 1.0474 | 7600  | 0.2655          | 0.0066                 | 0.0332 | 0.0993 | 97.6602 |
+| 0.1347        | 1.0808 | 8000  | 0.2659          | 0.0066                 | 0.0365 | 0.1258 | 97.2893 |
+| 0.1092        | 1.1141 | 8400  | 0.2496          | 0.0066                 | 0.0343 | 0.1192 | 97.6671 |
+| 0.111         | 1.1474 | 8800  | 0.2205          | 0.0066                 | 0.0221 | 0.0861 | 98.4693 |
+| 0.1033        | 1.1807 | 9200  | 0.2226          | 0.0066                 | 0.0254 | 0.0927 | 98.1761 |
+| 0.0919        | 1.2141 | 9600  | 0.1787          | 0.0066                 | 0.0210 | 0.0728 | 98.6440 |
+| 0.074         | 1.2474 | 10000 | 0.1756          | 0.0066                 | 0.0188 | 0.0464 | 99.3030 |
+| 0.0833        | 1.2808 | 10400 | 0.1830          | 0.0066                 | 0.0232 | 0.0728 | 98.8762 |
+| 0.057         | 1.3141 | 10800 | 0.1675          | 0.0066                 | 0.0133 | 0.0530 | 99.3276 |
+| 0.038         | 1.3474 | 11200 | 0.1709          | 0.0066                 | 0.0188 | 0.0596 | 98.9563 |
+| 0.0409        | 1.3807 | 11600 | 0.1400          | 0.0066                 | 0.0133 | 0.0530 | 99.2905 |
+| 0.0404        | 1.4141 | 12000 | 0.1423          | 0.0066                 | 0.0122 | 0.0464 | 99.2598 |
+
+
+### Framework versions
+
+- Transformers 4.46.3
+- Pytorch 2.5.1+cu121
+- Tokenizers 0.20.3

config.json

@@ -0,0 +1,174 @@
+{
+  "_name_or_path": "microsoft/trocr-base-handwritten",
+  "architectures": [
+    "VisionEncoderDecoderModel"
+  ],
+  "decoder": {
+    "_attn_implementation_autoset": false,
+    "_name_or_path": "",
+    "activation_dropout": 0.0,
+    "activation_function": "gelu",
+    "add_cross_attention": true,
+    "architectures": null,
+    "attention_dropout": 0.0,
+    "bad_words_ids": null,
+    "begin_suppress_tokens": null,
+    "bos_token_id": 0,
+    "chunk_size_feed_forward": 0,
+    "classifier_dropout": 0.0,
+    "cross_attention_hidden_size": 768,
+    "d_model": 1024,
+    "decoder_attention_heads": 16,
+    "decoder_ffn_dim": 4096,
+    "decoder_layerdrop": 0.0,
+    "decoder_layers": 12,
+    "decoder_start_token_id": 2,
+    "diversity_penalty": 0.0,
+    "do_sample": false,
+    "dropout": 0.1,
+    "early_stopping": false,
+    "encoder_no_repeat_ngram_size": 0,
+    "eos_token_id": 2,
+    "exponential_decay_length_penalty": null,
+    "finetuning_task": null,
+    "forced_bos_token_id": null,
+    "forced_eos_token_id": null,
+    "id2label": {
+      "0": "LABEL_0",
+      "1": "LABEL_1"
+    },
+    "init_std": 0.02,
+    "is_decoder": true,
+    "is_encoder_decoder": false,
+    "label2id": {
+      "LABEL_0": 0,
+      "LABEL_1": 1
+    },
+    "layernorm_embedding": true,
+    "length_penalty": 1.0,
+    "max_length": 20,
+    "max_position_embeddings": 512,
+    "min_length": 0,
+    "model_type": "trocr",
+    "no_repeat_ngram_size": 0,
+    "num_beam_groups": 1,
+    "num_beams": 1,
+    "num_return_sequences": 1,
+    "output_attentions": false,
+    "output_hidden_states": false,
+    "output_scores": false,
+    "pad_token_id": 1,
+    "prefix": null,
+    "problem_type": null,
+    "pruned_heads": {},
+    "remove_invalid_values": false,
+    "repetition_penalty": 1.0,
+    "return_dict": true,
+    "return_dict_in_generate": false,
+    "scale_embedding": false,
+    "sep_token_id": null,
+    "suppress_tokens": null,
+    "task_specific_params": null,
+    "temperature": 1.0,
+    "tf_legacy_loss": false,
+    "tie_encoder_decoder": false,
+    "tie_word_embeddings": true,
+    "tokenizer_class": null,
+    "top_k": 50,
+    "top_p": 1.0,
+    "torch_dtype": null,
+    "torchscript": false,
+    "typical_p": 1.0,
+    "use_bfloat16": false,
+    "use_cache": false,
+    "use_learned_position_embeddings": true,
+    "vocab_size": 50265
+  },
+  "decoder_start_token_id": 0,
+  "encoder": {
+    "_attn_implementation_autoset": false,
+    "_name_or_path": "",
+    "add_cross_attention": false,
+    "architectures": null,
+    "attention_probs_dropout_prob": 0.0,
+    "bad_words_ids": null,
+    "begin_suppress_tokens": null,
+    "bos_token_id": null,
+    "chunk_size_feed_forward": 0,
+    "cross_attention_hidden_size": null,
+    "decoder_start_token_id": null,
+    "diversity_penalty": 0.0,
+    "do_sample": false,
+    "early_stopping": false,
+    "encoder_no_repeat_ngram_size": 0,
+    "encoder_stride": 16,
+    "eos_token_id": null,
+    "exponential_decay_length_penalty": null,
+    "finetuning_task": null,
+    "forced_bos_token_id": null,
+    "forced_eos_token_id": null,
+    "hidden_act": "gelu",
+    "hidden_dropout_prob": 0.0,
+    "hidden_size": 768,
+    "id2label": {
+      "0": "LABEL_0",
+      "1": "LABEL_1"
+    },
+    "image_size": 384,
+    "initializer_range": 0.02,
+    "intermediate_size": 3072,
+    "is_decoder": false,
+    "is_encoder_decoder": false,
+    "label2id": {
+      "LABEL_0": 0,
+      "LABEL_1": 1
+    },
+    "layer_norm_eps": 1e-12,
+    "length_penalty": 1.0,
+    "max_length": 20,
+    "min_length": 0,
+    "model_type": "vit",
+    "no_repeat_ngram_size": 0,
+    "num_attention_heads": 12,
+    "num_beam_groups": 1,
+    "num_beams": 1,
+    "num_channels": 3,
+    "num_hidden_layers": 12,
+    "num_return_sequences": 1,
+    "output_attentions": false,
+    "output_hidden_states": false,
+    "output_scores": false,
+    "pad_token_id": null,
+    "patch_size": 16,
+    "prefix": null,
+    "problem_type": null,
+    "pruned_heads": {},
+    "qkv_bias": false,
+    "remove_invalid_values": false,
+    "repetition_penalty": 1.0,
+    "return_dict": true,
+    "return_dict_in_generate": false,
+    "sep_token_id": null,
+    "suppress_tokens": null,
+    "task_specific_params": null,
+    "temperature": 1.0,
+    "tf_legacy_loss": false,
+    "tie_encoder_decoder": false,
+    "tie_word_embeddings": true,
+    "tokenizer_class": null,
+    "top_k": 50,
+    "top_p": 1.0,
+    "torch_dtype": null,
+    "torchscript": false,
+    "typical_p": 1.0,
+    "use_bfloat16": false
+  },
+  "is_encoder_decoder": true,
+  "model_type": "vision-encoder-decoder",
+  "pad_token_id": 1,
+  "processor_class": "TrOCRProcessor",
+  "tie_word_embeddings": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.46.3",
+  "vocab_size": 50265
+}

generation_config.json

@@ -0,0 +1,13 @@
+{
+  "bos_token_id": 0,
+  "decoder_start_token_id": 2,
+  "early_stopping": true,
+  "eos_token_id": 2,
+  "length_penalty": 1.1,
+  "max_length": 64,
+  "no_repeat_ngram_size": 3,
+  "num_beams": 4,
+  "pad_token_id": 1,
+  "transformers_version": "4.46.3",
+  "use_cache": false
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:60474b94d4aa67289743f45eea521f27f6c02bf71ee689ffd8aad09cf85a634f
+size 1335747032

preprocessor_config.json

@@ -0,0 +1,22 @@
+{
+  "do_normalize": true,
+  "do_rescale": true,
+  "do_resize": true,
+  "image_mean": [
+    0.5,
+    0.5,
+    0.5
+  ],
+  "image_processor_type": "ViTImageProcessor",
+  "image_std": [
+    0.5,
+    0.5,
+    0.5
+  ],
+  "resample": 2,
+  "rescale_factor": 0.00392156862745098,
+  "size": {
+    "height": 384,
+    "width": 384
+  }
+}

runs/Dec09_11-01-10_e8c588f131b1/events.out.tfevents.1733742109.e8c588f131b1.377.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b5b1ad13a11e09b06046bc096742f24dd46a6b7fdf298e9a216d8e10a63a9e8c
+size 29274

runs/Dec09_12-05-48_e8c588f131b1/events.out.tfevents.1733745993.e8c588f131b1.377.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:994922334272df62679a681aae154723c22fd7c26e8434e51ffb578b8a808287
+size 49928

runs/Dec09_12-05-48_e8c588f131b1/events.out.tfevents.1733753882.e8c588f131b1.377.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8aef7d7c63d784c10cccb9cd925dfed233ee48fff482fb59848dc60c47c2c7c9
+size 568

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:11cb56a281d2b5b41bfa5ab077a4d6f548f351ca5cc413cd7556b023b1b13a5d
+size 5432