Hazde commited on
Commit
52000a7
·
verified ·
1 Parent(s): 632bfe0

End of training

Browse files
README.md CHANGED
@@ -14,9 +14,9 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  # careerbot_PG6_Qwen_Qwen2.5-0.5B-Instruct_model
16
 
17
- This model is a fine-tuned version of [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.7927
20
 
21
  ## Model description
22
 
@@ -45,44 +45,44 @@ The following hyperparameters were used during training:
45
  No additional optimizer arguments
46
  - lr_scheduler_type: linear
47
  - lr_scheduler_warmup_steps: 1
48
- - training_steps: 3372
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:-------:|:----:|:---------------:|
54
- | No log | 0.9953 | 105 | 1.1560 |
55
- | No log | 2.0 | 211 | 1.1306 |
56
- | No log | 2.9953 | 316 | 1.1640 |
57
- | No log | 4.0 | 422 | 1.2417 |
58
- | No log | 4.9953 | 527 | 1.2741 |
59
- | No log | 6.0 | 633 | 1.3009 |
60
- | No log | 6.9953 | 738 | 1.3479 |
61
- | No log | 8.0 | 844 | 1.4053 |
62
- | No log | 8.9953 | 949 | 1.4463 |
63
- | No log | 10.0 | 1055 | 1.4523 |
64
- | No log | 10.9953 | 1160 | 1.4646 |
65
- | No log | 12.0 | 1266 | 1.5013 |
66
- | No log | 12.9953 | 1371 | 1.4868 |
67
- | No log | 14.0 | 1477 | 1.5466 |
68
- | No log | 14.9953 | 1582 | 1.5501 |
69
- | No log | 16.0 | 1688 | 1.5816 |
70
- | No log | 16.9953 | 1793 | 1.5601 |
71
- | No log | 18.0 | 1899 | 1.5774 |
72
- | No log | 18.9953 | 2004 | 1.6338 |
73
- | No log | 20.0 | 2110 | 1.6242 |
74
- | No log | 20.9953 | 2215 | 1.6408 |
75
- | No log | 22.0 | 2321 | 1.6462 |
76
- | No log | 22.9953 | 2426 | 1.6565 |
77
- | No log | 24.0 | 2532 | 1.6767 |
78
- | No log | 24.9953 | 2637 | 1.7010 |
79
- | No log | 26.0 | 2743 | 1.6947 |
80
- | No log | 26.9953 | 2848 | 1.7124 |
81
- | No log | 28.0 | 2954 | 1.7340 |
82
- | No log | 28.9953 | 3059 | 1.7522 |
83
- | No log | 30.0 | 3165 | 1.7693 |
84
- | No log | 30.9953 | 3270 | 1.7857 |
85
- | No log | 31.9621 | 3372 | 1.7927 |
86
 
87
 
88
  ### Framework versions
 
14
 
15
  # careerbot_PG6_Qwen_Qwen2.5-0.5B-Instruct_model
16
 
17
+ This model is a fine-tuned version of [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 1.4229
20
 
21
  ## Model description
22
 
 
45
  No additional optimizer arguments
46
  - lr_scheduler_type: linear
47
  - lr_scheduler_warmup_steps: 1
48
+ - training_steps: 5072
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:-------:|:----:|:---------------:|
54
+ | No log | 0.9968 | 158 | 1.0200 |
55
+ | No log | 2.0 | 317 | 0.9880 |
56
+ | No log | 2.9968 | 475 | 0.9873 |
57
+ | No log | 4.0 | 634 | 1.0426 |
58
+ | No log | 4.9968 | 792 | 1.0514 |
59
+ | No log | 6.0 | 951 | 1.0938 |
60
+ | No log | 6.9968 | 1109 | 1.0742 |
61
+ | No log | 8.0 | 1268 | 1.1283 |
62
+ | No log | 8.9968 | 1426 | 1.1356 |
63
+ | No log | 10.0 | 1585 | 1.1581 |
64
+ | No log | 10.9968 | 1743 | 1.2045 |
65
+ | No log | 12.0 | 1902 | 1.2060 |
66
+ | No log | 12.9968 | 2060 | 1.2354 |
67
+ | No log | 14.0 | 2219 | 1.2285 |
68
+ | No log | 14.9968 | 2377 | 1.2401 |
69
+ | No log | 16.0 | 2536 | 1.2986 |
70
+ | No log | 16.9968 | 2694 | 1.2904 |
71
+ | No log | 18.0 | 2853 | 1.3051 |
72
+ | No log | 18.9968 | 3011 | 1.3109 |
73
+ | No log | 20.0 | 3170 | 1.3154 |
74
+ | No log | 20.9968 | 3328 | 1.3202 |
75
+ | No log | 22.0 | 3487 | 1.3282 |
76
+ | No log | 22.9968 | 3645 | 1.3385 |
77
+ | No log | 24.0 | 3804 | 1.3295 |
78
+ | No log | 24.9968 | 3962 | 1.3512 |
79
+ | No log | 26.0 | 4121 | 1.3583 |
80
+ | No log | 26.9968 | 4279 | 1.3666 |
81
+ | No log | 28.0 | 4438 | 1.3841 |
82
+ | No log | 28.9968 | 4596 | 1.3938 |
83
+ | No log | 30.0 | 4755 | 1.4084 |
84
+ | No log | 30.9968 | 4913 | 1.4178 |
85
+ | No log | 32.0 | 5072 | 1.4229 |
86
 
87
 
88
  ### Framework versions
final/model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f30e17170de16688a3a3917376557d1bced5de6fe9f96081d4168a4bc6f4d62b
3
  size 1976163472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3134c4f2d75f6e15416a893611ec1e7a77e291e97653e4b4a6e387c647018bc5
3
  size 1976163472
final/training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d94197438af42d64bd30a42a6ece732ecf162bd411b1d5e533e73e624febc7f9
3
  size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61d1fb868fb7e940d054b2fff8037bb7e301928d9faf9d47e1285ceb8f9c5539
3
  size 5304
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f30e17170de16688a3a3917376557d1bced5de6fe9f96081d4168a4bc6f4d62b
3
  size 1976163472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3134c4f2d75f6e15416a893611ec1e7a77e291e97653e4b4a6e387c647018bc5
3
  size 1976163472
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d94197438af42d64bd30a42a6ece732ecf162bd411b1d5e533e73e624febc7f9
3
  size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61d1fb868fb7e940d054b2fff8037bb7e301928d9faf9d47e1285ceb8f9c5539
3
  size 5304