Model save

README.md

@@ -1,5 +1,4 @@
 ---
-library_name: transformers
 license: mit
 base_model: gpt2
 tags:
@@ -12,11 +11,12 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/bacemtayeb/huggingface/runs/8eqwgkox)
 # tn_bacem_gpt2
 
 This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 4.1384
+- Loss: 5.2258
 
 ## Model description
 
@@ -44,21 +44,19 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_steps: 500
-- num_epochs: 5
+- num_epochs: 6
 
 ### Training results
 
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
-| 7.3317        | 1.0672 | 500  | 5.1399          |
-| 4.6653        | 2.1345 | 1000 | 4.3604          |
-| 4.1187        | 3.2017 | 1500 | 4.1806          |
-| 3.8061        | 4.2689 | 2000 | 4.1384          |
+| 7.8551        | 2.5974 | 500  | 6.0543          |
+| 5.4431        | 5.1948 | 1000 | 5.2258          |
 
 
 ### Framework versions
 
-- Transformers 4.45.1
-- Pytorch 2.4.0
-- Datasets 3.0.1
-- Tokenizers 0.20.0
+- Transformers 4.42.3
+- Pytorch 2.1.2
+- Datasets 2.20.0
+- Tokenizers 0.19.1

generation_config.json

@@ -2,5 +2,5 @@
   "_from_model_config": true,
   "bos_token_id": 50256,
   "eos_token_id": 50256,
-  "transformers_version": "4.45.1"
+  "transformers_version": "4.42.3"
 }