End of training

README.md

@@ -18,13 +18,13 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.1779
-- Eval/rewards/chosen: 3.0961
-- Eval/logps/chosen: -176.6188
-- Eval/rewards/rejected: 2.8259
-- Eval/logps/rejected: -193.3174
-- Eval/rewards/margins: 0.2702
-- Eval/kl: 24.7168
+- Loss: 1.1043
+- Eval/rewards/chosen: -0.1559
+- Eval/logps/chosen: -209.1386
+- Eval/rewards/rejected: -0.1992
+- Eval/logps/rejected: -223.5693
+- Eval/rewards/margins: 0.0434
+- Eval/kl: 0.0
 
 ## Model description
 
@@ -43,7 +43,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.0001
+- learning_rate: 1e-05
 - train_batch_size: 1
 - eval_batch_size: 2
 - seed: 9012
@@ -56,14 +56,14 @@ The following hyperparameters were used during training:
 
 ### Training results
 
-| Training Loss | Epoch  | Step | Validation Loss |         |
-|:-------------:|:------:|:----:|:---------------:|:-------:|
-| 0.7171        | 0.9412 | 12   | 0.8669          | 0.0     |
-| 0.4176        | 1.9608 | 25   | 1.0862          | 11.9864 |
-| 0.2679        | 2.9804 | 38   | 1.1516          | 17.8582 |
-| 0.1715        | 4.0    | 51   | 1.1719          | 23.9545 |
-| 0.1537        | 4.9412 | 63   | 1.1700          | 24.7377 |
-| 0.325         | 5.6471 | 72   | 1.1779          | 24.7168 |
+| Training Loss | Epoch  | Step | Validation Loss |        |
+|:-------------:|:------:|:----:|:---------------:|:------:|
+| 0.7709        | 0.9412 | 12   | 1.1519          | 0.0384 |
+| 0.7453        | 1.9608 | 25   | 1.1408          | 0.0025 |
+| 0.7183        | 2.9804 | 38   | 1.1208          | 0.0    |
+| 0.6972        | 4.0    | 51   | 1.1199          | 0.0    |
+| 0.7078        | 4.9412 | 63   | 1.1090          | 0.0016 |
+| 0.5307        | 5.6471 | 72   | 1.1043          | 0.0    |
 
 
 ### Framework versions

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ff2b2eb9b288eed8180429ef37b6b4e3958ad4986b9c283604743f4e6dac53a5
+oid sha256:6c46272a49d3f8cee679071f6197cb36adac8f289024b42863005fe92c34d509
 size 27297544

metrics.jsonl

@@ -112,3 +112,9 @@
 {"epoch": 4.0, "precision": 0.7096774170655566, "recall": 0.9166666628472222, "fold": 0}
 {"epoch": 4.9411764705882355, "precision": 0.7916666633680556, "recall": 0.7916666633680556, "fold": 0}
 {"epoch": 5.647058823529412, "precision": 0.7999999968, "recall": 0.8333333298611111, "fold": 0}
+{"epoch": 0.9411764705882353, "precision": 0.4444444436213992, "recall": 0.9999999958333333, "fold": 0}
+{"epoch": 1.9607843137254903, "precision": 0.47916666566840277, "recall": 0.9583333293402777, "fold": 0}
+{"epoch": 2.980392156862745, "precision": 0.45652173813799624, "recall": 0.8749999963541666, "fold": 0}
+{"epoch": 4.0, "precision": 0.4230769222633136, "recall": 0.9166666628472222, "fold": 0}
+{"epoch": 4.9411764705882355, "precision": 0.41999999915999997, "recall": 0.8749999963541666, "fold": 0}
+{"epoch": 5.647058823529412, "precision": 0.47916666566840277, "recall": 0.9583333293402777, "fold": 0}

metrics_epoch_0.9411764705882353_fold_0_lr_1e-05_seed_9012_weight_5.0.json

@@ -0,0 +1 @@
+{"epoch": 0.9411764705882353, "precision": 0.4444444436213992, "recall": 0.9999999958333333, "fold": 0}

metrics_epoch_1.9607843137254903_fold_0_lr_1e-05_seed_9012_weight_5.0.json

@@ -0,0 +1 @@
+{"epoch": 1.9607843137254903, "precision": 0.47916666566840277, "recall": 0.9583333293402777, "fold": 0}

metrics_epoch_2.980392156862745_fold_0_lr_1e-05_seed_9012_weight_5.0.json

@@ -0,0 +1 @@
+{"epoch": 2.980392156862745, "precision": 0.45652173813799624, "recall": 0.8749999963541666, "fold": 0}

metrics_epoch_4.0_fold_0_lr_1e-05_seed_9012_weight_5.0.json

@@ -0,0 +1 @@
+{"epoch": 4.0, "precision": 0.4230769222633136, "recall": 0.9166666628472222, "fold": 0}

metrics_epoch_4.9411764705882355_fold_0_lr_1e-05_seed_9012_weight_5.0.json

@@ -0,0 +1 @@
+{"epoch": 4.9411764705882355, "precision": 0.41999999915999997, "recall": 0.8749999963541666, "fold": 0}

metrics_epoch_5.647058823529412_fold_0_lr_1e-05_seed_9012_weight_5.0.json

@@ -0,0 +1 @@
+{"epoch": 5.647058823529412, "precision": 0.47916666566840277, "recall": 0.9583333293402777, "fold": 0}

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:28ec7bf8868727e6af608d55a688985efd09071eba2cf3d41ff0393020ae3fbe
+oid sha256:17d1cc7550239903db5c7966246500b720f8059322783a7c1e5f8da08cd93d5c
 size 5688