lsmille commited on
Commit
7b89698
·
verified ·
1 Parent(s): eac323f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -2
README.md CHANGED
@@ -20,7 +20,25 @@ It achieves the following results on the evaluation set:
20
 
21
  ## Model description
22
 
23
- More information needed
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
24
 
25
  ## Intended uses & limitations
26
 
@@ -28,7 +46,7 @@ More information needed
28
 
29
  ## Training and evaluation data
30
 
31
- More information needed
32
 
33
  ## Training procedure
34
 
 
20
 
21
  ## Model description
22
 
23
+ *BEST MODEL*
24
+
25
+ lora_alpha = 32
26
+
27
+ lora_dropout = 0.05
28
+
29
+ lora_r = 16
30
+
31
+ epochs = 3
32
+
33
+ learning rate = 3e-4
34
+
35
+ warmup_steps=0.5
36
+
37
+ gradient_accumulation_steps = 1 <---- virtual batch of 1 (update every sample)
38
+
39
+ train_batch = 1
40
+
41
+ eval_batch = 1
42
 
43
  ## Intended uses & limitations
44
 
 
46
 
47
  ## Training and evaluation data
48
 
49
+ in files
50
 
51
  ## Training procedure
52