acrobatlm/mistral-7binstruct-summary-100s

README.md

@@ -20,7 +20,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the generator dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.4779
+- Loss: 1.5011
 
 ## Model description
 
@@ -50,16 +50,16 @@ The following hyperparameters were used during training:
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss |
-|:-------------:|:-----:|:----:|:---------------:|
-| 1.6991        | 0.22  | 25   | 1.5629          |
-| 1.5556        | 0.43  | 50   | 1.4779          |
+| Training Loss | Epoch  | Step | Validation Loss |
+|:-------------:|:------:|:----:|:---------------:|
+| 1.7176        | 0.2212 | 25   | 1.5722          |
+| 1.6267        | 0.4425 | 50   | 1.5011          |
 
 
 ### Framework versions
 
 - PEFT 0.10.0
-- Transformers 4.39.3
+- Transformers 4.40.0
 - Pytorch 2.2.1+cu121
 - Datasets 2.18.0
-- Tokenizers 0.15.2
+- Tokenizers 0.19.1

adapter_config.json

@@ -20,8 +20,8 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "v_proj",
-    "q_proj"
+    "q_proj",
+    "v_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e44ce263e6fd885f50d82ca515b9325375b43ee36ededb75acf161ce88bc2e41
-size 48
+oid sha256:9f57bef3246c59c405878b3b707cfc3831e31b553c1484785fd7e68070267572
+size 27280152

runs/Apr18_22-54-02_18e887ddd35f/events.out.tfevents.1713480856.18e887ddd35f.760.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4a909060915a57b1724efc804d7aae7422b08a9d54a4788ee9cdf78c170ee2f4
+size 7113

tokenizer.json

@@ -134,6 +134,7 @@
     "end_of_word_suffix": null,
     "fuse_unk": true,
     "byte_fallback": true,
+    "ignore_merges": false,
     "vocab": {
       "<unk>": 0,
       "<s>": 1,

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1db73b3e4c5624152527ba9989b5aa678eb274c40f26ac111b55a0540e66b8d9
-size 4920
+oid sha256:d8efaceddd2df97653d20329fcbef2324da8fcd9963392ed719431681c04db7f
+size 4984