KasaiDanto commited on
Commit
7eb9c5b
·
verified ·
1 Parent(s): 441e333

End of training

Browse files
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [google/gemma-2-2b-it](https://huggingface.co/google/gemma-2-2b-it) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.8753
20
 
21
  ## Model description
22
 
@@ -49,8 +49,8 @@ The following hyperparameters were used during training:
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:------:|:----:|:---------------:|
52
- | 2.0282 | 0.9999 | 3912 | 1.9913 |
53
- | 1.8359 | 1.9999 | 7824 | 1.8753 |
54
 
55
 
56
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [google/gemma-2-2b-it](https://huggingface.co/google/gemma-2-2b-it) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 1.8714
20
 
21
  ## Model description
22
 
 
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:------:|:----:|:---------------:|
52
+ | 2.0284 | 0.9999 | 3912 | 1.9896 |
53
+ | 1.8333 | 1.9999 | 7824 | 1.8714 |
54
 
55
 
56
  ### Framework versions
adapter_config.json CHANGED
@@ -23,13 +23,13 @@
23
  "rank_pattern": {},
24
  "revision": null,
25
  "target_modules": [
26
- "q_proj",
27
- "k_proj",
28
- "v_proj",
29
- "down_proj",
30
  "up_proj",
31
  "o_proj",
32
- "gate_proj"
 
 
 
33
  ],
34
  "task_type": "CAUSAL_LM",
35
  "use_dora": false,
 
23
  "rank_pattern": {},
24
  "revision": null,
25
  "target_modules": [
26
+ "gate_proj",
 
 
 
27
  "up_proj",
28
  "o_proj",
29
+ "k_proj",
30
+ "q_proj",
31
+ "v_proj",
32
+ "down_proj"
33
  ],
34
  "task_type": "CAUSAL_LM",
35
  "use_dora": false,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f8da6f3dbe733ac47c06fba7bda016d5e584db81408cf04b053b5744923fd057
3
  size 41581360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca7694b8d99e89831c12d08934afa23af19376655a159fcf33dfc62626161b85
3
  size 41581360
runs/Dec26_22-57-13_5bff9903db84/events.out.tfevents.1735253834.5bff9903db84.23.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f219d0b3133a92b5fba308da37be109ee861043dbfe1fb86bf17b9b5952656b3
3
+ size 9734
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7d611d6b33680a34110ae1dab24d1a2f0c00ad68343156f4d624282967675b6c
3
  size 5240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:804b22f39944de83bf0b1947728010fd472ca24601b8608c2ac45fa6284b98df
3
  size 5240