morturr commited on
Commit
b6b6fea
·
verified ·
1 Parent(s): 93e7511

End of training

Browse files
README.md CHANGED
@@ -35,7 +35,7 @@ More information needed
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
- - learning_rate: 5e-06
39
  - train_batch_size: 8
40
  - eval_batch_size: 8
41
  - seed: 42
 
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
+ - learning_rate: 5e-05
39
  - train_batch_size: 8
40
  - eval_batch_size: 8
41
  - seed: 42
adapter_config.json CHANGED
@@ -10,7 +10,7 @@
10
  "layers_pattern": null,
11
  "layers_to_transform": null,
12
  "loftq_config": {},
13
- "lora_alpha": 16,
14
  "lora_dropout": 0.1,
15
  "megatron_config": null,
16
  "megatron_core": "megatron.core",
 
10
  "layers_pattern": null,
11
  "layers_to_transform": null,
12
  "loftq_config": {},
13
+ "lora_alpha": 64,
14
  "lora_dropout": 0.1,
15
  "megatron_config": null,
16
  "megatron_core": "megatron.core",
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7f049794a2be3af8fcb8f75b46a6a2ad97c17401b4eba2c02352665a76ff3b31
3
  size 109069176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04c8a179861eb4d27df60c434bb52223c31b51c5e6c14e69ad73e18c3d8d66e0
3
  size 109069176
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f0e5cb04549ab79bf3995a5cbfefb7b268395fdf6229ea557f700e2b447cc83f
3
  size 5624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:431951b25576e38ea6edc91d611dd1b53e64672212bffc6b10acd7297bd4ed20
3
  size 5624