Update README.md

README.md

@@ -189,7 +189,7 @@ special_tokens:
 
 </details><br>
 
-# outputs/lora-out
+# magistrate-3.2-3b-base
 
 This model is a fine-tuned version of [meta-llama/Llama-3.2-3B](https://huggingface.co/meta-llama/Llama-3.2-3B) on the None dataset.
 It achieves the following results on the evaluation set:
@@ -197,7 +197,7 @@ It achieves the following results on the evaluation set:
 
 ## Model description
 
-More information needed
+This is a base model trained on US Supreme Court proceedings, US federal code and regulations. This is a proof of concept for a larger model as it can be very expensive to finetune something like a 70B.
 
 ## Intended uses & limitations
 
@@ -209,6 +209,8 @@ More information needed
 
 ## Training procedure
 
+Spectrum top 35% fine tune. Methodology based on Cohere's paper: To Code, or Not To Code? Exploring Impact of Code in Pre-training
+
 ### Training hyperparameters
 
 The following hyperparameters were used during training: