Model save

README.md

@@ -16,10 +16,10 @@ should probably proofread and complete it, then remove this comment. -->
 
 # peft_ft_random
 
-This model is a fine-tuned version of [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on an unknown dataset.
+This model is a fine-tuned version of [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 8.3484
-- Accuracy: 35231.7155
+- Loss: 8.4980
+- Accuracy: -5564.7596
 
 ## Model description
 
@@ -51,13 +51,12 @@ The following hyperparameters were used during training:
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Accuracy   |
-|:-------------:|:-----:|:----:|:---------------:|:----------:|
-| No log        | 1.0   | 1    | 9.2515          | 27671.5006 |
-| No log        | 2.0   | 2    | 8.3332          | 33462.3978 |
-| No log        | 3.0   | 3    | 7.9205          | 37044.5995 |
-| No log        | 4.0   | 4    | 7.7660          | 38733.4134 |
-| No log        | 5.0   | 5    | 8.3484          | 35231.7155 |
+| Training Loss | Epoch | Step | Validation Loss | Accuracy    |
+|:-------------:|:-----:|:----:|:---------------:|:-----------:|
+| No log        | 0.8   | 2    | 10.1306         | 48758.8852  |
+| No log        | 2.0   | 5    | 9.1696          | 68666.5148  |
+| No log        | 2.8   | 7    | 8.8054          | -22131.0614 |
+| 9.5148        | 4.0   | 10   | 8.4980          | -5564.7596  |
 
 
 ### Framework versions
@@ -65,5 +64,5 @@ The following hyperparameters were used during training:
 - PEFT 0.11.1
 - Transformers 4.41.1
 - Pytorch 2.3.0+cu121
-- Datasets 2.19.1
+- Datasets 2.19.2
 - Tokenizers 0.19.1

adapter_1/adapter_config.json

@@ -20,8 +20,8 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "query",
-    "value"
+    "value",
+    "query"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_1/adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3e9ecb7a73023e49dec77e40200b905e6152b4fd069ab619436f8109a9c0f84e
+oid sha256:cdee2675981a3b2b140f9f80514e33be5a64e60f9cf389e189330391cfc82d74
 size 9443984

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0d997fe8ac5f1c0f849cb68e473410b909b23ac1c00c4b8e2878981d6259f93d
+oid sha256:310cfdf3ac11194ea72a604335f03d3b9121724758aefadd42e47ebec41c94fd
 size 9443984