Update README.md
Browse files
README.md
CHANGED
@@ -21,19 +21,21 @@ should probably proofread and complete it, then remove this comment. -->
|
|
21 |
|
22 |
This model, `tinyllama-colorist-lora-v0.3`, is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v0.3](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v0.3) on the color dataset.
|
23 |
|
24 |
-
##
|
25 |
|
26 |
-
|
27 |
|
28 |
-
##
|
|
|
|
|
|
|
|
|
29 |
|
30 |
-
|
31 |
-
|
32 |
-
|
33 |
-
|
34 |
-
|
35 |
-
|
36 |
-
## Training procedure
|
37 |
|
38 |
### Training hyperparameters
|
39 |
|
|
|
21 |
|
22 |
This model, `tinyllama-colorist-lora-v0.3`, is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v0.3](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v0.3) on the color dataset.
|
23 |
|
24 |
+
## <font color="yellow">Study Motivation</font>
|
25 |
|
26 |
+
To study this new TinyLlama model as a replacement for Llama2 for resource-constrained environment. Also, in the future I will perform the Fine-Tuning of this model for Chat and for a specific domain in Portuguese and Spanish 🤗.
|
27 |
|
28 |
+
## <font color="yellow">Prompt format</font>
|
29 |
+
The model training process is similar to the regular Llama2 model with a chat prompt format like this:
|
30 |
+
```
|
31 |
+
<|im_start|>user\n{question}<|im_end|>\n<|im_start|>assistant\n{answer}<|im_end|>\n
|
32 |
+
```
|
33 |
|
34 |
+
## <font color="yellow">Instructions for use</font>
|
35 |
+
```
|
36 |
+
User Input: Give me a sky blue color.
|
37 |
+
LLM response: #6092ff
|
38 |
+
```
|
|
|
|
|
39 |
|
40 |
### Training hyperparameters
|
41 |
|