Update README.md
Browse filesUpdated the training method
README.md
CHANGED
@@ -10,7 +10,7 @@ tags:
|
|
10 |
|
11 |
This is proof of concept to see how far LLM's on the smaller side can go when fine-tuned for code generation and understanding.
|
12 |
|
13 |
-
The base model is based on OpenLlama-3b and can be found [here](https://huggingface.co/psmathur/orca_mini_3b) and it has been
|
14 |
Unlike the base model the prompt is based on Alapaca.
|
15 |
|
16 |
Next there are some examples to show what the model is currently capable of.
|
|
|
10 |
|
11 |
This is proof of concept to see how far LLM's on the smaller side can go when fine-tuned for code generation and understanding.
|
12 |
|
13 |
+
The base model is based on OpenLlama-3b and can be found [here](https://huggingface.co/psmathur/orca_mini_3b) and it has been fine-tuned with LoRA using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl/tree/main).
|
14 |
Unlike the base model the prompt is based on Alapaca.
|
15 |
|
16 |
Next there are some examples to show what the model is currently capable of.
|