Update README.md

README.md

@@ -33,5 +33,25 @@ JiviMed-8B redefines what's possible in biomedical language modeling, setting ne
 | BioMistral/BioMistral-7B                           | 56.36   | 41.48   | 46.11 | 51.11        | 63.77                  | 61.11                | 53.76                 | 66                     | 52.94                        | 71       |
 
 
+<details>
+
+<summary>Hyperparametes:</summary>
+
+Peft
+* lora_r: 64
+* lora_alpha: 128
+* lora_dropout: 0.05
+* lora_target_linear: true
+
+Target_Modules
+* q_proj
+* v_proj
+* k_proj
+* o_proj
+* gate_proj
+* down_proj
+* up_proj
+</details>
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d31285220242a508a30523/vuTwmEk3xxPmOi7hly0Kr.png)