Model save
Browse files
README.md
CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
14 |
|
15 |
This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on an unknown dataset.
|
16 |
It achieves the following results on the evaluation set:
|
17 |
-
- Loss: 2.
|
18 |
|
19 |
## Model description
|
20 |
|
@@ -39,22 +39,32 @@ The following hyperparameters were used during training:
|
|
39 |
- seed: 42
|
40 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
41 |
- lr_scheduler_type: linear
|
42 |
-
- training_steps:
|
43 |
|
44 |
### Training results
|
45 |
|
46 |
| Training Loss | Epoch | Step | Validation Loss |
|
47 |
|:-------------:|:-----:|:----:|:---------------:|
|
48 |
-
| 2.
|
49 |
-
| 2.
|
50 |
-
| 2.
|
51 |
-
| 2.
|
52 |
-
| 2.
|
53 |
-
| 2.
|
54 |
-
| 2.
|
55 |
-
| 2.
|
56 |
-
| 2.
|
57 |
-
| 2.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
58 |
|
59 |
|
60 |
### Framework versions
|
|
|
14 |
|
15 |
This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on an unknown dataset.
|
16 |
It achieves the following results on the evaluation set:
|
17 |
+
- Loss: 2.1092
|
18 |
|
19 |
## Model description
|
20 |
|
|
|
39 |
- seed: 42
|
40 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
41 |
- lr_scheduler_type: linear
|
42 |
+
- training_steps: 200
|
43 |
|
44 |
### Training results
|
45 |
|
46 |
| Training Loss | Epoch | Step | Validation Loss |
|
47 |
|:-------------:|:-----:|:----:|:---------------:|
|
48 |
+
| 2.7967 | 0.22 | 10 | 2.7779 |
|
49 |
+
| 2.5905 | 0.44 | 20 | 2.5530 |
|
50 |
+
| 2.3863 | 0.67 | 30 | 2.4699 |
|
51 |
+
| 2.3334 | 0.89 | 40 | 2.3923 |
|
52 |
+
| 2.313 | 1.11 | 50 | 2.3418 |
|
53 |
+
| 2.0965 | 1.33 | 60 | 2.2902 |
|
54 |
+
| 2.2402 | 1.56 | 70 | 2.2599 |
|
55 |
+
| 2.213 | 1.78 | 80 | 2.2329 |
|
56 |
+
| 2.1118 | 2.0 | 90 | 2.2142 |
|
57 |
+
| 2.071 | 2.22 | 100 | 2.1969 |
|
58 |
+
| 2.0024 | 2.44 | 110 | 2.1846 |
|
59 |
+
| 2.0814 | 2.67 | 120 | 2.1692 |
|
60 |
+
| 2.0853 | 2.89 | 130 | 2.1540 |
|
61 |
+
| 1.9573 | 3.11 | 140 | 2.1419 |
|
62 |
+
| 1.9231 | 3.33 | 150 | 2.1358 |
|
63 |
+
| 1.921 | 3.56 | 160 | 2.1240 |
|
64 |
+
| 1.9618 | 3.78 | 170 | 2.1166 |
|
65 |
+
| 2.0817 | 4.0 | 180 | 2.1120 |
|
66 |
+
| 2.0458 | 4.22 | 190 | 2.1102 |
|
67 |
+
| 1.9076 | 4.44 | 200 | 2.1092 |
|
68 |
|
69 |
|
70 |
### Framework versions
|
adapter_model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 16794200
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9cfd9d88b14058fbf3ad8ce7f236add4e59c361dba6448a89d28a1cd7aaa299d
|
3 |
size 16794200
|
runs/Mar08_05-13-17_f651f6e07434/events.out.tfevents.1709874815.f651f6e07434.915.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:446052604db23d640a5afc0d1fba0d8f98de32cd8e409da8ee44417aff7e6235
|
3 |
+
size 14923
|
runs/Mar08_05-13-17_f651f6e07434/events.out.tfevents.1709879717.f651f6e07434.915.1
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3cfba032c97405d80d52371d681932752fceea760ca7c57e4c5665be3191ee85
|
3 |
+
size 359
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 4856
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e4a6eff38eb5e666f4a74d12cf9f1f08bca89d3040a9ba99e04778a0b5f7043c
|
3 |
size 4856
|