End of training

README.md

@@ -18,13 +18,13 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.0917
-- Eval/rewards/chosen: -0.8414
-- Eval/logps/chosen: -201.2396
-- Eval/rewards/rejected: -0.9419
-- Eval/logps/rejected: -239.2882
-- Eval/rewards/margins: 0.1005
-- Eval/kl: 0.0
+- Loss: 0.6455
+- Eval/rewards/chosen: 4.7894
+- Eval/logps/chosen: -155.6419
+- Eval/rewards/rejected: 5.2271
+- Eval/logps/rejected: -162.9411
+- Eval/rewards/margins: -0.4377
+- Eval/kl: 43.6119
 
 ## Model description
 
@@ -43,10 +43,10 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 1e-05
+- learning_rate: 0.0001
 - train_batch_size: 1
 - eval_batch_size: 2
-- seed: 1234
+- seed: 5678
 - gradient_accumulation_steps: 8
 - total_train_batch_size: 8
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
@@ -56,14 +56,14 @@ The following hyperparameters were used during training:
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss |        |
-|:-------------:|:-----:|:----:|:---------------:|:------:|
-| 3.2209        | 0.96  | 12   | 1.3225          | 0.0157 |
-| 1.9694        | 2.0   | 25   | 1.2416          | 0.0    |
-| 2.2976        | 2.96  | 37   | 1.1633          | 0.0    |
-| 1.5033        | 4.0   | 50   | 1.1103          | 0.0    |
-| 1.7639        | 4.96  | 62   | 1.0895          | 0.0    |
-| 1.3062        | 5.76  | 72   | 1.0917          | 0.0    |
+| Training Loss | Epoch | Step | Validation Loss |         |
+|:-------------:|:-----:|:----:|:---------------:|:-------:|
+| 0.5679        | 0.96  | 12   | 0.6448          | 20.8699 |
+| 0.5325        | 2.0   | 25   | 0.6455          | 26.6031 |
+| 0.3496        | 2.96  | 37   | 0.6709          | 45.2104 |
+| 0.3441        | 4.0   | 50   | 0.6451          | 43.6726 |
+| 0.301         | 4.96  | 62   | 0.6455          | 43.6419 |
+| 0.2008        | 5.76  | 72   | 0.6455          | 43.6119 |
 
 
 ### Framework versions

adapter_config.json

@@ -20,9 +20,9 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "k_proj",
     "v_proj",
     "q_proj",
+    "k_proj",
     "o_proj"
   ],
   "task_type": "CAUSAL_LM",

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:03a7e2f5c9ec7835f5cba668e0f49b88fc9d3834182d78f7d43ca22c3627d6ca
+oid sha256:763dc40f4f2883187955c51c77d044098ddf876800d3144b34e3828e3155d8da
 size 27297544

metrics.jsonl

@@ -58,3 +58,9 @@
 {"epoch": 4.0, "precision": 0.5624999982421874, "recall": 0.9999999944444444, "fold": 0}
 {"epoch": 4.96, "precision": 0.6153846130177515, "recall": 0.8888888839506173, "fold": 0}
 {"epoch": 5.76, "precision": 0.5999999976, "recall": 0.8333333287037037, "fold": 0}
+{"epoch": 0.96, "precision": 0.4210526304709141, "recall": 0.8888888839506173, "fold": 0}
+{"epoch": 2.0, "precision": 0.8461538396449705, "recall": 0.6111111077160494, "fold": 0}
+{"epoch": 2.96, "precision": 0.5714285693877551, "recall": 0.8888888839506173, "fold": 0}
+{"epoch": 4.0, "precision": 0.6363636334710744, "recall": 0.7777777734567901, "fold": 0}
+{"epoch": 4.96, "precision": 0.6666666638888888, "recall": 0.8888888839506173, "fold": 0}
+{"epoch": 5.76, "precision": 0.5517241360285374, "recall": 0.8888888839506173, "fold": 0}

metrics_epoch_0.96_fold_0_lr_0.0001_seed_5678_weight_2.0.json

@@ -0,0 +1 @@
+{"epoch": 0.96, "precision": 0.4210526304709141, "recall": 0.8888888839506173, "fold": 0}

metrics_epoch_2.0_fold_0_lr_0.0001_seed_5678_weight_2.0.json

@@ -0,0 +1 @@
+{"epoch": 2.0, "precision": 0.8461538396449705, "recall": 0.6111111077160494, "fold": 0}

metrics_epoch_2.96_fold_0_lr_0.0001_seed_5678_weight_2.0.json

@@ -0,0 +1 @@
+{"epoch": 2.96, "precision": 0.5714285693877551, "recall": 0.8888888839506173, "fold": 0}

metrics_epoch_4.0_fold_0_lr_0.0001_seed_5678_weight_2.0.json

@@ -0,0 +1 @@
+{"epoch": 4.0, "precision": 0.6363636334710744, "recall": 0.7777777734567901, "fold": 0}

metrics_epoch_4.96_fold_0_lr_0.0001_seed_5678_weight_2.0.json

@@ -0,0 +1 @@
+{"epoch": 4.96, "precision": 0.6666666638888888, "recall": 0.8888888839506173, "fold": 0}

metrics_epoch_5.76_fold_0_lr_0.0001_seed_5678_weight_2.0.json

@@ -0,0 +1 @@
+{"epoch": 5.76, "precision": 0.5517241360285374, "recall": 0.8888888839506173, "fold": 0}

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:30ced44d801d4a06b88c5bdfaa381f53508cf093350b9fd4b96ff2f2bfa704d4
+oid sha256:3b77e80cfba41e2290c4e3b89b7f10aa24f675bf156f962b6388f622572a4915
 size 5688