morturr commited on
Commit
c7d214d
·
verified ·
1 Parent(s): 147b474

End of training

Browse files
README.md CHANGED
@@ -35,7 +35,7 @@ More information needed
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
- - learning_rate: 5e-05
39
  - train_batch_size: 8
40
  - eval_batch_size: 8
41
  - seed: 42
 
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
+ - learning_rate: 5e-06
39
  - train_batch_size: 8
40
  - eval_batch_size: 8
41
  - seed: 42
adapter_config.json CHANGED
@@ -10,7 +10,7 @@
10
  "layers_pattern": null,
11
  "layers_to_transform": null,
12
  "loftq_config": {},
13
- "lora_alpha": 8,
14
  "lora_dropout": 0.1,
15
  "megatron_config": null,
16
  "megatron_core": "megatron.core",
 
10
  "layers_pattern": null,
11
  "layers_to_transform": null,
12
  "loftq_config": {},
13
+ "lora_alpha": 32,
14
  "lora_dropout": 0.1,
15
  "megatron_config": null,
16
  "megatron_core": "megatron.core",
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f87a75534a2f88db59185c7bc1efbbe0a05631b75cddb89afaeadd9824173e4c
3
  size 218121344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6398b4df7da0494c6e62bee81a5ea23141d0f5f8869ee3b6a978c3655e80498e
3
  size 218121344
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bb84e2efc3d65a32b6f0a92ea6177127ca427bc920133290d81bfa9de0f5b90e
3
  size 5624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c778a438a22bfba845626db29bf9c7db4d3e8783eca0e3c501970a5535822ff
3
  size 5624