CHIH-HUNG
/

llama-2-13b-FINETUNE2_TEST_2.2w

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

CHIH-HUNG commited on Sep 4, 2023

Commit

864d599

•

1 Parent(s): 6d7b97b

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -14,7 +14,7 @@ datasets:
 - **model:** meta-llama/Llama-2-13b-hf
 - **dataset:** huangyt/FINETUNE2_TEST (共約2.2w筆訓練集)
 - **peft_type:** LoRA
-- **lora_target:** q_proj, v_proj
 - **per_device_train_batch_size:** 8
 - **gradient_accumulation_steps:** 8
 - **learning_rate :** 5e-5

 - **model:** meta-llama/Llama-2-13b-hf
 - **dataset:** huangyt/FINETUNE2_TEST (共約2.2w筆訓練集)
 - **peft_type:** LoRA
+- **lora_target:** gate_proj, up_proj, down_proj
 - **per_device_train_batch_size:** 8
 - **gradient_accumulation_steps:** 8
 - **learning_rate :** 5e-5