Hugging Face's logo

xuanye
/
llama3_question

PEFT
TensorBoard
Safetensors
Generated from Trainer
Model card Files Metrics Community
xuanye commited on
Commit
0827a4f
·
verified ·
1 Parent(s): ec1f2af

end of training

Browse files
Files changed (3) hide show
  1. README.md +43 -43
  2. adapter_model.safetensors +1 -1
  3. runs/Jun10_21-41-38_ml/events.out.tfevents.1718026901.ml.3182975.0 +2 -2
README.md CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model was trained from scratch on the None dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.9219
18
 
19
  ## Model description
20
 
@@ -58,48 +58,48 @@ The following hyperparameters were used during training:
58
 
59
  | Training Loss | Epoch | Step | Validation Loss |
60
  |:-------------:|:-----:|:----:|:---------------:|
61
- | 2.9644 | 0.14 | 1 | 2.8251 |
62
- | 2.8305 | 0.29 | 2 | 2.6593 |
63
- | 2.6303 | 0.43 | 3 | 2.5000 |
64
- | 2.5879 | 0.57 | 4 | 2.3661 |
65
- | 2.3771 | 0.71 | 5 | 2.2414 |
66
- | 2.2551 | 0.86 | 6 | 2.1226 |
67
- | 2.5345 | 1.0 | 7 | 2.0163 |
68
- | 2.0127 | 1.14 | 8 | 1.9162 |
69
- | 1.9111 | 1.29 | 9 | 1.8193 |
70
- | 1.8992 | 1.43 | 10 | 1.7328 |
71
- | 1.8365 | 1.57 | 11 | 1.6515 |
72
- | 1.5802 | 1.71 | 12 | 1.5855 |
73
- | 1.5701 | 1.86 | 13 | 1.5264 |
74
- | 1.6198 | 2.0 | 14 | 1.4761 |
75
- | 1.4501 | 2.14 | 15 | 1.4274 |
76
- | 1.4337 | 2.29 | 16 | 1.3790 |
77
- | 1.3655 | 2.43 | 17 | 1.3319 |
78
- | 1.3056 | 2.57 | 18 | 1.2820 |
79
- | 1.3507 | 2.71 | 19 | 1.2314 |
80
- | 1.2097 | 2.86 | 20 | 1.1834 |
81
- | 1.0763 | 3.0 | 21 | 1.1399 |
82
- | 1.1076 | 3.14 | 22 | 1.0996 |
83
- | 1.1287 | 3.29 | 23 | 1.0602 |
84
- | 1.0127 | 3.43 | 24 | 1.0254 |
85
- | 0.9368 | 3.57 | 25 | 0.9962 |
86
- | 0.8688 | 3.71 | 26 | 0.9760 |
87
- | 1.0289 | 3.86 | 27 | 0.9634 |
88
- | 1.1598 | 4.0 | 28 | 0.9573 |
89
- | 0.8651 | 4.14 | 29 | 0.9504 |
90
- | 0.9333 | 4.29 | 30 | 0.9462 |
91
- | 0.76 | 4.43 | 31 | 0.9414 |
92
- | 0.8858 | 4.57 | 32 | 0.9381 |
93
- | 0.8953 | 4.71 | 33 | 0.9344 |
94
- | 0.9548 | 4.86 | 34 | 0.9318 |
95
- | 0.8858 | 5.0 | 35 | 0.9293 |
96
- | 0.7921 | 5.14 | 36 | 0.9263 |
97
- | 0.7928 | 5.29 | 37 | 0.9238 |
98
- | 0.8796 | 5.43 | 38 | 0.9231 |
99
- | 0.8282 | 5.57 | 39 | 0.9225 |
100
- | 0.9103 | 5.71 | 40 | 0.9223 |
101
- | 0.7536 | 5.86 | 41 | 0.9201 |
102
- | 0.9409 | 6.0 | 42 | 0.9219 |
103
 
104
 
105
  ### Framework versions
 
14
 
15
  This model was trained from scratch on the None dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.8999
18
 
19
  ## Model description
20
 
 
58
 
59
  | Training Loss | Epoch | Step | Validation Loss |
60
  |:-------------:|:-----:|:----:|:---------------:|
61
+ | 2.9948 | 0.14 | 1 | 2.8184 |
62
+ | 2.8697 | 0.29 | 2 | 2.6592 |
63
+ | 2.6264 | 0.43 | 3 | 2.4946 |
64
+ | 2.625 | 0.57 | 4 | 2.3588 |
65
+ | 2.3888 | 0.71 | 5 | 2.2385 |
66
+ | 2.2949 | 0.86 | 6 | 2.1219 |
67
+ | 2.5261 | 1.0 | 7 | 2.0221 |
68
+ | 2.0264 | 1.14 | 8 | 1.9246 |
69
+ | 1.9661 | 1.29 | 9 | 1.8298 |
70
+ | 1.9106 | 1.43 | 10 | 1.7456 |
71
+ | 1.8448 | 1.57 | 11 | 1.6686 |
72
+ | 1.619 | 1.71 | 12 | 1.6050 |
73
+ | 1.5881 | 1.86 | 13 | 1.5468 |
74
+ | 1.6859 | 2.0 | 14 | 1.4939 |
75
+ | 1.4643 | 2.14 | 15 | 1.4453 |
76
+ | 1.4583 | 2.29 | 16 | 1.3949 |
77
+ | 1.4086 | 2.43 | 17 | 1.3441 |
78
+ | 1.3314 | 2.57 | 18 | 1.2914 |
79
+ | 1.3502 | 2.71 | 19 | 1.2400 |
80
+ | 1.226 | 2.86 | 20 | 1.1892 |
81
+ | 1.073 | 3.0 | 21 | 1.1445 |
82
+ | 1.1113 | 3.14 | 22 | 1.0995 |
83
+ | 1.1292 | 3.29 | 23 | 1.0570 |
84
+ | 1.0242 | 3.43 | 24 | 1.0164 |
85
+ | 0.9279 | 3.57 | 25 | 0.9826 |
86
+ | 0.8518 | 3.71 | 26 | 0.9617 |
87
+ | 1.0302 | 3.86 | 27 | 0.9491 |
88
+ | 1.1736 | 4.0 | 28 | 0.9418 |
89
+ | 0.8832 | 4.14 | 29 | 0.9352 |
90
+ | 0.9151 | 4.29 | 30 | 0.9301 |
91
+ | 0.7495 | 4.43 | 31 | 0.9256 |
92
+ | 0.8785 | 4.57 | 32 | 0.9220 |
93
+ | 0.8635 | 4.71 | 33 | 0.9180 |
94
+ | 0.9499 | 4.86 | 34 | 0.9150 |
95
+ | 0.8744 | 5.0 | 35 | 0.9125 |
96
+ | 0.8221 | 5.14 | 36 | 0.9093 |
97
+ | 0.7826 | 5.29 | 37 | 0.9064 |
98
+ | 0.8421 | 5.43 | 38 | 0.9047 |
99
+ | 0.8155 | 5.57 | 39 | 0.9029 |
100
+ | 0.9097 | 5.71 | 40 | 0.9010 |
101
+ | 0.7449 | 5.86 | 41 | 0.9003 |
102
+ | 0.9502 | 6.0 | 42 | 0.8999 |
103
 
104
 
105
  ### Framework versions
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:251715a5fb08a7c77c9f24f4561be02bad319bb61a780b97f07f963c819e65db
3
  size 109069176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3054c04cf91784e07a8916322fe5fe7b2ab267bfe6a203504484a37c682702a9
3
  size 109069176
runs/Jun10_21-41-38_ml/events.out.tfevents.1718026901.ml.3182975.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:737f0b737191481fd1d4ba3b55ef34f389361359172eceefe58eead4cf5499ff
3
- size 21241
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91a3691bcec4f6071d4a657da0b7f4a484cfd195a412e334a7afb3e06191e150
3
+ size 22849