End of training

README.md

@@ -1,7 +1,7 @@
 ---
 library_name: transformers
 license: mit
-base_model: microsoft/MiniLM-L12-H384-uncased
+base_model: EleutherAI/gpt-neo-125M
 tags:
 - generated_from_trainer
 datasets:
@@ -16,9 +16,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 # my_awesome_eli5_clm-model
 
-This model is a fine-tuned version of [microsoft/MiniLM-L12-H384-uncased](https://huggingface.co/microsoft/MiniLM-L12-H384-uncased) on the eli5_category dataset.
+This model is a fine-tuned version of [EleutherAI/gpt-neo-125M](https://huggingface.co/EleutherAI/gpt-neo-125M) on the eli5_category dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2947
+- Loss: 3.6742
 
 ## Model description
 
@@ -49,9 +49,9 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 1.498         | 1.0   | 1369 | 0.6652          |
-| 0.5345        | 2.0   | 2738 | 0.3477          |
-| 0.3861        | 3.0   | 4107 | 0.2947          |
+| 3.6598        | 1.0   | 1308 | 3.6774          |
+| 3.5083        | 2.0   | 2616 | 3.6719          |
+| 3.4294        | 3.0   | 3924 | 3.6742          |
 
 
 ### Framework versions

generation_config.json

@@ -1,5 +1,6 @@
 {
   "_from_model_config": true,
-  "pad_token_id": 0,
+  "bos_token_id": 50256,
+  "eos_token_id": 50256,
   "transformers_version": "4.46.3"
 }

runs/Dec10_09-59-49_38cecd41f61e/events.out.tfevents.1733824790.38cecd41f61e.283.2

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fd379e4aac4ee91fcbd985bd9b84ac8199df3379b4b4323b4f5439bfe940daba
-size 7538
+oid sha256:68fbd61a7d88ed9b846d84076016a4922b98d1c1d52a682aa6e3c16dd4c8eec7
+size 8163

runs/Dec10_09-59-49_38cecd41f61e/events.out.tfevents.1733826300.38cecd41f61e.283.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e845ab6088b98cadee2ab648e425127e7313b22f00486a5a82faff435733ea21
+size 359