gopalakrishnan-d
commited on
Commit
•
b5d5d98
1
Parent(s):
bbf88bd
Update README.md
Browse files
README.md
CHANGED
@@ -33,8 +33,8 @@ This version has been specifically enhanced for better performance on diverse la
|
|
33 |
- **Developed by:** gopalakrishnan-d
|
34 |
- **Model type:** Fine-Tuned LLM
|
35 |
- **Language(s) (NLP):** English
|
36 |
-
- **License:**
|
37 |
-
- **Finetuned from model
|
38 |
|
39 |
## Uses
|
40 |
|
@@ -53,7 +53,7 @@ This version has been specifically enhanced for better performance on diverse la
|
|
53 |
- gradient_accumulation_steps: 1
|
54 |
- optimizer: Adam
|
55 |
- lr_scheduler_type: linear
|
56 |
-
- lr_scheduler_warmup_ratio: 0.
|
57 |
- lora_rank=16
|
58 |
- lora_alpha=32
|
59 |
|
|
|
33 |
- **Developed by:** gopalakrishnan-d
|
34 |
- **Model type:** Fine-Tuned LLM
|
35 |
- **Language(s) (NLP):** English
|
36 |
+
- **License:**Apache 2.0 License**
|
37 |
+
- **Finetuned from model:** VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct
|
38 |
|
39 |
## Uses
|
40 |
|
|
|
53 |
- gradient_accumulation_steps: 1
|
54 |
- optimizer: Adam
|
55 |
- lr_scheduler_type: linear
|
56 |
+
- lr_scheduler_warmup_ratio: 0.03
|
57 |
- lora_rank=16
|
58 |
- lora_alpha=32
|
59 |
|