gwonny commited on
Commit
65f2b3e
·
verified ·
1 Parent(s): e12ff53

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -8,7 +8,8 @@ language:
8
  We made a LLM model with beomi/llama-2-koen-13b
9
 
10
  ## Model Description
11
- We use QLoRA and NEFTune on LLM Fine-tuning
 
12
 
13
  ## Train Detail
14
  Our Korean Wiki QA data used, and 3 epoch train
 
8
  We made a LLM model with beomi/llama-2-koen-13b
9
 
10
  ## Model Description
11
+ We use QLoRA(64, 16) and NEFTune on LLM Fine-tuning
12
+ lr = 2e-4,
13
 
14
  ## Train Detail
15
  Our Korean Wiki QA data used, and 3 epoch train