Hugging Face's logo

Jonasbukhave
/
shawgpt-ft-epoch-17

PEFT
TensorBoard
Safetensors
Generated from Trainer
Model card Files Metrics Community
Jonasbukhave commited on
Commit
98f4591
·
verified ·
1 Parent(s): 325eedb

shawgpt-ft-epoch-17

Browse files
Files changed (3) hide show
  1. README.md +20 -20
  2. runs/Feb18_19-17-59_9a3887f9873e/events.out.tfevents.1739906279.9a3887f9873e.3474.6 +3 -0
  3. training_args.bin +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [TheBloke/Mistral-7B-Instruct-v0.2-GPTQ](https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GPTQ) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 2.6168
20
 
21
  ## Model description
22
 
@@ -51,29 +51,29 @@ The following hyperparameters were used during training:
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:-------:|:----:|:---------------:|
54
- | 8.5018 | 0.5714 | 1 | 4.2401 |
55
- | 8.5358 | 1.5714 | 2 | 4.1591 |
56
- | 8.0877 | 2.5714 | 3 | 3.9716 |
57
- | 7.7629 | 3.5714 | 4 | 3.7879 |
58
- | 7.3443 | 4.5714 | 5 | 3.6202 |
59
- | 7.0525 | 5.5714 | 6 | 3.4621 |
60
- | 6.7639 | 6.5714 | 7 | 3.3163 |
61
- | 6.4843 | 7.5714 | 8 | 3.1840 |
62
- | 6.2574 | 8.5714 | 9 | 3.0666 |
63
- | 6.0887 | 9.5714 | 10 | 2.9645 |
64
- | 5.8105 | 10.5714 | 11 | 2.8762 |
65
- | 5.6722 | 11.5714 | 12 | 2.8019 |
66
- | 5.538 | 12.5714 | 13 | 2.7407 |
67
- | 5.4225 | 13.5714 | 14 | 2.6918 |
68
- | 5.3219 | 14.5714 | 15 | 2.6548 |
69
- | 5.2683 | 15.5714 | 16 | 2.6297 |
70
- | 2.6273 | 16.5714 | 17 | 2.6168 |
71
 
72
 
73
  ### Framework versions
74
 
75
  - PEFT 0.14.0
76
- - Transformers 4.48.3
77
- - Pytorch 2.5.1+cu124
78
  - Datasets 3.3.1
79
  - Tokenizers 0.21.0
 
16
 
17
  This model is a fine-tuned version of [TheBloke/Mistral-7B-Instruct-v0.2-GPTQ](https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GPTQ) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 2.6155
20
 
21
  ## Model description
22
 
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:-------:|:----:|:---------------:|
54
+ | 25.5434 | 0.5714 | 1 | 4.2401 |
55
+ | 25.6938 | 1.5714 | 2 | 4.1565 |
56
+ | 24.646 | 2.5714 | 3 | 3.9657 |
57
+ | 23.5063 | 3.5714 | 4 | 3.7821 |
58
+ | 22.2803 | 4.5714 | 5 | 3.6134 |
59
+ | 21.3242 | 5.5714 | 6 | 3.4549 |
60
+ | 20.3798 | 6.5714 | 7 | 3.3075 |
61
+ | 19.658 | 7.5714 | 8 | 3.1749 |
62
+ | 18.9316 | 8.5714 | 9 | 3.0579 |
63
+ | 18.1952 | 9.5714 | 10 | 2.9563 |
64
+ | 17.5537 | 10.5714 | 11 | 2.8690 |
65
+ | 17.0554 | 11.5714 | 12 | 2.7957 |
66
+ | 16.6773 | 12.5714 | 13 | 2.7354 |
67
+ | 16.3041 | 13.5714 | 14 | 2.6879 |
68
+ | 15.9872 | 14.5714 | 15 | 2.6520 |
69
+ | 15.7942 | 15.5714 | 16 | 2.6279 |
70
+ | 10.5046 | 16.5714 | 17 | 2.6155 |
71
 
72
 
73
  ### Framework versions
74
 
75
  - PEFT 0.14.0
76
+ - Transformers 4.47.1
77
+ - Pytorch 2.5.1+cu121
78
  - Datasets 3.3.1
79
  - Tokenizers 0.21.0
runs/Feb18_19-17-59_9a3887f9873e/events.out.tfevents.1739906279.9a3887f9873e.3474.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b75b916ccd96e87f5b15b77e2b7e0c8d4b65262e77f5c659e69cf524a9ad55e
3
+ size 14137
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a43561b7d9eb4946dc4ae3a4dbeb826674d9d177a9e4121b581dfb63836f0789
3
  size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e5e1b4231f9ec15c59266c9e9531f234583cf3cca0e3a2d75960600d846942c
3
  size 5304