Hugging Face's logo

thrunlab
/
sparse_llama_7b_hf_refined_web_50p_2024-03-24

Text Generation
Transformers
Safetensors
sparse_llama
Generated from Trainer
custom_code
Model card Files Community
lukeleeai commited on
Commit
f5a25e5
·
verified ·
1 Parent(s): a767d20

End of training

Browse files
Files changed (4) hide show
  1. README.md +10 -2
  2. model-00001-of-00003.safetensors +1 -1
  3. model-00002-of-00003.safetensors +1 -1
  4. model-00003-of-00003.safetensors +1 -1
README.md CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 2.1138
18
 
19
  ## Model description
20
 
@@ -44,7 +44,7 @@ The following hyperparameters were used during training:
44
  - total_eval_batch_size: 4
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
47
- - training_steps: 600
48
 
49
  ### Training results
50
 
@@ -74,6 +74,14 @@ The following hyperparameters were used during training:
74
  | 2.1627 | 0.18 | 550 | 2.3730 |
75
  | 2.2769 | 0.18 | 575 | 2.3687 |
76
  | 2.1621 | 0.19 | 600 | 2.3702 |
 
 
 
 
 
 
 
 
77
 
78
 
79
  ### Framework versions
 
14
 
15
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 2.1073
18
 
19
  ## Model description
20
 
 
44
  - total_eval_batch_size: 4
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
47
+ - training_steps: 800
48
 
49
  ### Training results
50
 
 
74
  | 2.1627 | 0.18 | 550 | 2.3730 |
75
  | 2.2769 | 0.18 | 575 | 2.3687 |
76
  | 2.1621 | 0.19 | 600 | 2.3702 |
77
+ | 2.191 | 0.2 | 625 | 2.3696 |
78
+ | 2.274 | 0.21 | 650 | 2.3692 |
79
+ | 2.172 | 0.22 | 675 | 2.3720 |
80
+ | 2.1948 | 0.22 | 700 | 2.3704 |
81
+ | 2.2184 | 0.23 | 725 | 2.3699 |
82
+ | 2.1154 | 0.24 | 750 | 2.3693 |
83
+ | 2.1967 | 0.25 | 775 | 2.3699 |
84
+ | 2.2482 | 0.26 | 800 | 2.3668 |
85
 
86
 
87
  ### Framework versions
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:21f25ad6159d04d934b1203a2f58cda1711b2f3b17b2cb9be07beb7e681b866f
3
  size 4938985352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41b71b4ca54425e10fe07e316ddf636d9f6c2bface8f0aae7bfd22ee8f21567c
3
  size 4938985352
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:011b3adf2c64f7a22a88d7ead06b036ff71d40a09c5905d7706497a240c760c0
3
  size 4947390880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:faa7d7d5030984a61059cd9624005f814eb2a2ae1cdb70b4b84cb22b53a25b92
3
  size 4947390880
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d9d5a1d333a538055c2bb40e000311de5342c2e6fb2e0e7b6b206c3dc692eaf8
3
  size 3590488816
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70919e475956d280cb0b85dc2319d51290f24e6c2d4406147518900e922c32e6
3
  size 3590488816