EddyGiusepe commited on
Commit
3de0b29
·
verified ·
1 Parent(s): c51987d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -10
README.md CHANGED
@@ -21,19 +21,21 @@ should probably proofread and complete it, then remove this comment. -->
21
 
22
  This model, `tinyllama-colorist-lora-v0.3`, is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v0.3](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v0.3) on the color dataset.
23
 
24
- ## Model description
25
 
26
- More information needed
27
 
28
- ## Intended uses & limitations
 
 
 
 
29
 
30
- More information needed
31
-
32
- ## Training and evaluation data
33
-
34
- More information needed
35
-
36
- ## Training procedure
37
 
38
  ### Training hyperparameters
39
 
 
21
 
22
  This model, `tinyllama-colorist-lora-v0.3`, is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v0.3](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v0.3) on the color dataset.
23
 
24
+ ## <font color="yellow">Study Motivation</font>
25
 
26
+ To study this new TinyLlama model as a replacement for Llama2 for resource-constrained environment. Also, in the future I will perform the Fine-Tuning of this model for Chat and for a specific domain in Portuguese and Spanish 🤗.
27
 
28
+ ## <font color="yellow">Prompt format</font>
29
+ The model training process is similar to the regular Llama2 model with a chat prompt format like this:
30
+ ```
31
+ <|im_start|>user\n{question}<|im_end|>\n<|im_start|>assistant\n{answer}<|im_end|>\n
32
+ ```
33
 
34
+ ## <font color="yellow">Instructions for use</font>
35
+ ```
36
+ User Input: Give me a sky blue color.
37
+ LLM response: #6092ff
38
+ ```
 
 
39
 
40
  ### Training hyperparameters
41