Nan-Do commited on
Commit
f492d73
·
1 Parent(s): c842d52

Update README.md

Browse files

Updated formating

Files changed (1) hide show
  1. README.md +7 -1
README.md CHANGED
@@ -7,6 +7,7 @@ tags:
7
  - assistant
8
  - code
9
  ---
 
10
  TLDR;
11
  - The model is quite fun to play with as it seems pretty competent, much better than general bigger models.
12
  - It shows a good understanding about coding:
@@ -18,11 +19,16 @@ TLDR;
18
  - Sometimes you won't be able to make the model do what you want.
19
  - When dealing with coding problems it fails completely.
20
 
21
- This is proof of concept to see how far LLM's on the smaller side can go when fine-tuned for code generation and understanding.
 
 
 
22
 
 
23
  The base model is based on OpenLlama-3b and can be found [here](https://huggingface.co/psmathur/orca_mini_3b) and it has been fine-tuned with LoRA using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl/tree/main).
24
  Unlike the base model the prompt is based on Alpaca.
25
 
 
26
  Next there are some examples to show what the model is currently capable of.
27
  (I have edited the quotes to be able to show the prompts correctly here the model outputs proper markdown.)
28
 
 
7
  - assistant
8
  - code
9
  ---
10
+
11
  TLDR;
12
  - The model is quite fun to play with as it seems pretty competent, much better than general bigger models.
13
  - It shows a good understanding about coding:
 
19
  - Sometimes you won't be able to make the model do what you want.
20
  - When dealing with coding problems it fails completely.
21
 
22
+ ---------------------------------------------------------------
23
+
24
+ ### Objective:
25
+ This is a proof of concept to see how far LLM's on the smaller side can go when fine-tuned for code generation and understanding.
26
 
27
+ ### Foundation:
28
  The base model is based on OpenLlama-3b and can be found [here](https://huggingface.co/psmathur/orca_mini_3b) and it has been fine-tuned with LoRA using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl/tree/main).
29
  Unlike the base model the prompt is based on Alpaca.
30
 
31
+ ### Examples:
32
  Next there are some examples to show what the model is currently capable of.
33
  (I have edited the quotes to be able to show the prompts correctly here the model outputs proper markdown.)
34