eryk-mazus
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -16,7 +16,7 @@ inference: false
|
|
16 |
|
17 |
# Polka-1.1B-Chat
|
18 |
|
19 |
-
`eryk-mazus/polka-1.1b-chat` **is the first
|
20 |
|
21 |
The model is based on [TinyLlama-1.1B](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T) with the custom, extended tokenizer for more efficient Polish text generation, that was additionally pretrained on 5.7 billion tokens. **It was then fine-tuned on around 60k synthetically generated and machine-translated multi-turn conversations with the [Direct Preference Optimization (DPO)](https://arxiv.org/abs/2305.18290) performed on top of it.**
|
22 |
|
|
|
16 |
|
17 |
# Polka-1.1B-Chat
|
18 |
|
19 |
+
`eryk-mazus/polka-1.1b-chat` **is the first polish model trained to act as a helpful, conversational assistant that can be run locally.**
|
20 |
|
21 |
The model is based on [TinyLlama-1.1B](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T) with the custom, extended tokenizer for more efficient Polish text generation, that was additionally pretrained on 5.7 billion tokens. **It was then fine-tuned on around 60k synthetically generated and machine-translated multi-turn conversations with the [Direct Preference Optimization (DPO)](https://arxiv.org/abs/2305.18290) performed on top of it.**
|
22 |
|