End of training

README.md

@@ -1,23 +1,23 @@
 ---
-base_model: ahxt/llama1_s_1.8B_experimental
+base_model: NousResearch/Llama-2-7b-hf
 library_name: peft
 tags:
 - trl
 - sft
 - generated_from_trainer
 model-index:
-- name: Cold-Rec-LLama-2-7B
+- name: Cold-Data-LLama-2-7B
   results: []
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-# Cold-Rec-LLama-2-7B
+# Cold-Data-LLama-2-7B
 
-This model is a fine-tuned version of [ahxt/llama1_s_1.8B_experimental](https://huggingface.co/ahxt/llama1_s_1.8B_experimental) on the None dataset.
+This model is a fine-tuned version of [NousResearch/Llama-2-7b-hf](https://huggingface.co/NousResearch/Llama-2-7b-hf) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0777
+- Loss: 0.0526
 
 ## Model description
 
@@ -36,7 +36,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.001
+- learning_rate: 0.002
 - train_batch_size: 16
 - eval_batch_size: 32
 - seed: 42
@@ -51,11 +51,11 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 0.2217        | 1.992 | 249  | 0.2119          |
-| 0.1599        | 3.984 | 498  | 0.1558          |
-| 0.1177        | 5.976 | 747  | 0.1157          |
-| 0.0842        | 7.968 | 996  | 0.0875          |
-| 0.075         | 9.96  | 1245 | 0.0776          |
+| 0.1019        | 1.992 | 249  | 0.1022          |
+| 0.0542        | 3.984 | 498  | 0.0540          |
+| 0.0508        | 5.976 | 747  | 0.0513          |
+| 0.0479        | 7.968 | 996  | 0.0515          |
+| 0.0472        | 9.96  | 1245 | 0.0537          |
 
 
 ### Framework versions

runs/Aug12_10-44-55_fastgpuserv/events.out.tfevents.1723720304.fastgpuserv.2458899.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6c8160446538513f3946805cc0ef72e0e251a33474478fadbe680f3557397b78
+size 359