Hugging Face's logo

oljike
/
mistral_lora_clm_with_added_tokens

PEFT
TensorBoard
Safetensors
Generated from Trainer
Model card Files Metrics Community
oljike commited on
Commit
1fed85e
·
verified ·
1 Parent(s): f9f2743

End of training

Browse files
Files changed (7) hide show
  1. README.md +2 -2
  2. adapter_config.json +2 -2
  3. adapter_model.safetensors +1 -1
  4. emissions.csv +2 -1
  5. runs/Jun26_07-02-12_ca1e4e9f9585/events.out.tfevents.1719385333.ca1e4e9f9585.5430.0 +3 -0
  6. runs/Jun26_07-32-54_ca1e4e9f9585/events.out.tfevents.1719387176.ca1e4e9f9585.5596.0 +3 -0
  7. training_args.bin +1 -1
README.md CHANGED
@@ -33,13 +33,13 @@ More information needed
33
 
34
  The following hyperparameters were used during training:
35
  - learning_rate: 1e-05
36
- - train_batch_size: 4
37
  - eval_batch_size: 8
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
  - lr_scheduler_warmup_steps: 10
42
- - num_epochs: 1
43
  - mixed_precision_training: Native AMP
44
 
45
  ### Training results
 
33
 
34
  The following hyperparameters were used during training:
35
  - learning_rate: 1e-05
36
+ - train_batch_size: 2
37
  - eval_batch_size: 8
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
  - lr_scheduler_warmup_steps: 10
42
+ - num_epochs: 2
43
  - mixed_precision_training: Native AMP
44
 
45
  ### Training results
adapter_config.json CHANGED
@@ -24,9 +24,9 @@
24
  "revision": null,
25
  "target_modules": [
26
  "q_proj",
 
27
  "embed_tokens",
28
- "lm_head",
29
- "v_proj"
30
  ],
31
  "task_type": null,
32
  "use_dora": false,
 
24
  "revision": null,
25
  "target_modules": [
26
  "q_proj",
27
+ "v_proj",
28
  "embed_tokens",
29
+ "lm_head"
 
30
  ],
31
  "task_type": null,
32
  "use_dora": false,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a916f20ef1df23d4b567969441f31dab5fe83a866eb324e56411d21dcb917031
3
  size 2278180616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60f0c1f72c27a793e5507972365da15b207803621a33217423a6a76b3e54962e
3
  size 2278180616
emissions.csv CHANGED
@@ -1,2 +1,3 @@
1
  timestamp,experiment_id,project_name,duration,emissions,energy_consumed,country_name,country_iso_code,region,on_cloud,cloud_provider,cloud_region
2
- 2024-06-26T06:37:53,5fec5f0f-a05d-4293-813c-b3e6dc1fc6ed,codecarbon,30.19522476196289,0.0017345122745984838,0.002259665755317045,Oman,OMN,muscat,N,,
 
 
1
  timestamp,experiment_id,project_name,duration,emissions,energy_consumed,country_name,country_iso_code,region,on_cloud,cloud_provider,cloud_region
2
+ 2024-06-26T07:03:43,4c05a11f-ddcc-4970-9bc8-d5281d9d8c1a,codecarbon,88.79371523857117,0.006430792433576961,0.00837782565999405,Oman,OMN,muscat,N,,
3
+ 2024-06-26T07:34:26,a942ce2f-50b0-4e19-a396-38f9b566df7f,codecarbon,89.534339427948,0.006428364174851782,0.008374662204095412,Oman,OMN,muscat,N,,
runs/Jun26_07-02-12_ca1e4e9f9585/events.out.tfevents.1719385333.ca1e4e9f9585.5430.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42e8b245eb203107473210cd0dcb859b0627990ad498a46ce74ee54fc6fb34ed
3
+ size 10642
runs/Jun26_07-32-54_ca1e4e9f9585/events.out.tfevents.1719387176.ca1e4e9f9585.5596.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb2311cb87ab99961156245f0c84d7b01699bb18204b704511c60140e53f9207
3
+ size 10642
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6650b8c3af64f2353bd64c014099f1e3a6fe61150c1e559deda1baa1129a44dc
3
  size 5176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fbd40e3784342fc1859e481137b6375eb6be6c67340073cec8d64e2a4e897f3f
3
  size 5176