Hugging Face's logo

seanmemery
/
MLP-FinLLM-7b-it

Text Generation
Transformers
Safetensors
llama
trl
sft
unsloth
Generated from Trainer
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
seanmemery commited on
Commit
5fa1c65
·
verified ·
1 Parent(s): bcfa80d

Model save

Browse files
Files changed (3) hide show
  1. README.md +5 -5
  2. model-00003-of-00003.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -19,7 +19,7 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on the generator dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 0.4477
23
 
24
  ## Model description
25
 
@@ -50,14 +50,14 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss |
52
  |:-------------:|:-----:|:----:|:---------------:|
53
- | 0.5318 | 1.22 | 50 | 0.7765 |
54
- | 0.3087 | 2.44 | 100 | 0.5196 |
55
- | 0.2107 | 3.66 | 150 | 0.4477 |
56
 
57
 
58
  ### Framework versions
59
 
60
  - Transformers 4.38.2
61
- - Pytorch 2.2.0
62
  - Datasets 2.18.0
63
  - Tokenizers 0.15.2
 
19
 
20
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on the generator dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.4445
23
 
24
  ## Model description
25
 
 
50
 
51
  | Training Loss | Epoch | Step | Validation Loss |
52
  |:-------------:|:-----:|:----:|:---------------:|
53
+ | 0.5449 | 1.22 | 50 | 0.7534 |
54
+ | 0.3165 | 2.44 | 100 | 0.5170 |
55
+ | 0.2331 | 3.66 | 150 | 0.4445 |
56
 
57
 
58
  ### Framework versions
59
 
60
  - Transformers 4.38.2
61
+ - Pytorch 2.1.2+cu121
62
  - Datasets 2.18.0
63
  - Tokenizers 0.15.2
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:01939c0537b2ec1424ce8b93c60ff8c83eaf5d182fd96a1363fc9df733a00012
3
  size 3590488816
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ccc4f799b79f21e7f4ecb78a6ffe71b27e86b77276c3715ca4e4f35cd1ca44e
3
  size 3590488816
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2c869046df8152a302d8366e3954e884a909dc505faba2f31297f28195c73adb
3
  size 4984
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b9cff8bb188f3a39907a28f0304afeafe897e730109552304d8d0f868342de4
3
  size 4984