furquan commited on
Commit
cab9dba
·
1 Parent(s): 48aa6b6

Final push

Browse files
README.md CHANGED
@@ -3,14 +3,14 @@ base_model: meta-llama/Llama-2-7b-chat-hf
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
- - name: tmp_trainer
7
  results: []
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
  should probably proofread and complete it, then remove this comment. -->
12
 
13
- # tmp_trainer
14
 
15
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on an unknown dataset.
16
 
@@ -31,13 +31,15 @@ More information needed
31
  ### Training hyperparameters
32
 
33
  The following hyperparameters were used during training:
34
- - learning_rate: 5e-05
35
- - train_batch_size: 8
36
  - eval_batch_size: 8
37
  - seed: 42
 
 
38
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
39
  - lr_scheduler_type: linear
40
- - num_epochs: 3.0
41
 
42
  ### Training results
43
 
 
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
+ - name: Llama2-sentiment-prompt-tuned
7
  results: []
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
  should probably proofread and complete it, then remove this comment. -->
12
 
13
+ # Llama2-sentiment-prompt-tuned
14
 
15
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on an unknown dataset.
16
 
 
31
  ### Training hyperparameters
32
 
33
  The following hyperparameters were used during training:
34
+ - learning_rate: 0.001
35
+ - train_batch_size: 4
36
  - eval_batch_size: 8
37
  - seed: 42
38
+ - gradient_accumulation_steps: 2
39
+ - total_train_batch_size: 8
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
42
+ - num_epochs: 2
43
 
44
  ### Training results
45
 
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d1e283894c6e05d4270c245d31e464782d37ce8023288878d1160bd87586c94d
3
  size 262264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd687875a70a13c5e123a5e76b3b2f6efc99eb8479663f55f68f3e5b9cf9a62a
3
  size 262264
runs/Nov08_20-49-09_respai/events.out.tfevents.1699494584.respai CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b9c37ef93f9f69c869c45dce835c410764e3309733945f4ecfaaa5802824c9e9
3
- size 13518
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d68ac3f06d76234ed37717a59f2fb77e116c6edb77e51a696293f1b2462ef440
3
+ size 15285