Nan-Do commited on
Commit
5c362d8
1 Parent(s): c5be8a5

Update README.md

Browse files

Updated the training method

Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -10,7 +10,7 @@ tags:
10
 
11
  This is proof of concept to see how far LLM's on the smaller side can go when fine-tuned for code generation and understanding.
12
 
13
- The base model is based on OpenLlama-3b and can be found [here](https://huggingface.co/psmathur/orca_mini_3b) and it has been trained using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl/tree/main).
14
  Unlike the base model the prompt is based on Alapaca.
15
 
16
  Next there are some examples to show what the model is currently capable of.
 
10
 
11
  This is proof of concept to see how far LLM's on the smaller side can go when fine-tuned for code generation and understanding.
12
 
13
+ The base model is based on OpenLlama-3b and can be found [here](https://huggingface.co/psmathur/orca_mini_3b) and it has been fine-tuned with LoRA using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl/tree/main).
14
  Unlike the base model the prompt is based on Alapaca.
15
 
16
  Next there are some examples to show what the model is currently capable of.