End of training

README.md

@@ -18,13 +18,13 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.6455
-- Eval/rewards/chosen: 4.7894
-- Eval/logps/chosen: -155.6419
-- Eval/rewards/rejected: 5.2271
-- Eval/logps/rejected: -162.9411
-- Eval/rewards/margins: -0.4377
-- Eval/kl: 43.6119
+- Loss: 0.6329
+- Eval/rewards/chosen: 0.4406
+- Eval/logps/chosen: -199.1299
+- Eval/rewards/rejected: 0.4160
+- Eval/logps/rejected: -211.0515
+- Eval/rewards/margins: 0.0246
+- Eval/kl: 4.1837
 
 ## Model description
 
@@ -43,7 +43,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.0001
+- learning_rate: 1e-05
 - train_batch_size: 1
 - eval_batch_size: 2
 - seed: 5678
@@ -56,14 +56,14 @@ The following hyperparameters were used during training:
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss |         |
-|:-------------:|:-----:|:----:|:---------------:|:-------:|
-| 0.5679        | 0.96  | 12   | 0.6448          | 20.8699 |
-| 0.5325        | 2.0   | 25   | 0.6455          | 26.6031 |
-| 0.3496        | 2.96  | 37   | 0.6709          | 45.2104 |
-| 0.3441        | 4.0   | 50   | 0.6451          | 43.6726 |
-| 0.301         | 4.96  | 62   | 0.6455          | 43.6419 |
-| 0.2008        | 5.76  | 72   | 0.6455          | 43.6119 |
+| Training Loss | Epoch | Step | Validation Loss |        |
+|:-------------:|:-----:|:----:|:---------------:|:------:|
+| 0.5565        | 0.96  | 12   | 0.6326          | 0.3559 |
+| 0.6102        | 2.0   | 25   | 0.6329          | 1.4255 |
+| 0.5449        | 2.96  | 37   | 0.6345          | 2.7750 |
+| 0.6022        | 4.0   | 50   | 0.6340          | 3.7858 |
+| 0.5433        | 4.96  | 62   | 0.6299          | 4.1605 |
+| 0.5345        | 5.76  | 72   | 0.6329          | 4.1837 |
 
 
 ### Framework versions

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:763dc40f4f2883187955c51c77d044098ddf876800d3144b34e3828e3155d8da
+oid sha256:3dd591cc2f02afedb7aff8f59694291964f5cd8e3a725f077720a3dd67b1a56d
 size 27297544

metrics.jsonl

@@ -64,3 +64,9 @@
 {"epoch": 4.0, "precision": 0.6363636334710744, "recall": 0.7777777734567901, "fold": 0}
 {"epoch": 4.96, "precision": 0.6666666638888888, "recall": 0.8888888839506173, "fold": 0}
 {"epoch": 5.76, "precision": 0.5517241360285374, "recall": 0.8888888839506173, "fold": 0}
+{"epoch": 0.96, "precision": 0.28846153790680473, "recall": 0.8333333287037037, "fold": 0}
+{"epoch": 2.0, "precision": 0.38297872258940696, "recall": 0.9999999944444444, "fold": 0}
+{"epoch": 2.96, "precision": 0.33333333259259257, "recall": 0.8333333287037037, "fold": 0}
+{"epoch": 4.0, "precision": 0.3673469380258226, "recall": 0.9999999944444444, "fold": 0}
+{"epoch": 4.96, "precision": 0.3617021268899955, "recall": 0.9444444391975308, "fold": 0}
+{"epoch": 5.76, "precision": 0.33999999931999997, "recall": 0.9444444391975308, "fold": 0}

metrics_epoch_0.96_fold_0_lr_1e-05_seed_5678_weight_2.0.json

@@ -0,0 +1 @@
+{"epoch": 0.96, "precision": 0.28846153790680473, "recall": 0.8333333287037037, "fold": 0}

metrics_epoch_2.0_fold_0_lr_1e-05_seed_5678_weight_2.0.json

@@ -0,0 +1 @@
+{"epoch": 2.0, "precision": 0.38297872258940696, "recall": 0.9999999944444444, "fold": 0}

metrics_epoch_2.96_fold_0_lr_1e-05_seed_5678_weight_2.0.json

@@ -0,0 +1 @@
+{"epoch": 2.96, "precision": 0.33333333259259257, "recall": 0.8333333287037037, "fold": 0}

metrics_epoch_4.0_fold_0_lr_1e-05_seed_5678_weight_2.0.json

@@ -0,0 +1 @@
+{"epoch": 4.0, "precision": 0.3673469380258226, "recall": 0.9999999944444444, "fold": 0}

metrics_epoch_4.96_fold_0_lr_1e-05_seed_5678_weight_2.0.json

@@ -0,0 +1 @@
+{"epoch": 4.96, "precision": 0.3617021268899955, "recall": 0.9444444391975308, "fold": 0}

metrics_epoch_5.76_fold_0_lr_1e-05_seed_5678_weight_2.0.json

@@ -0,0 +1 @@
+{"epoch": 5.76, "precision": 0.33999999931999997, "recall": 0.9444444391975308, "fold": 0}

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3b77e80cfba41e2290c4e3b89b7f10aa24f675bf156f962b6388f622572a4915
+oid sha256:2803958bc9902aecb85baabef1bfd3edaaaace9da9f997204d7dad9c8e16a590
 size 5688