Update README.md
Browse files
README.md
CHANGED
|
@@ -19,9 +19,9 @@ model-index:
|
|
| 19 |
verified: false
|
| 20 |
---
|
| 21 |
|
| 22 |
-
#
|
| 23 |
|
| 24 |
-
This is a 159M parameters model with teh same architecture as [StarCoder]() (8k context length, MQA & FIM). It was trained on the Python data from StarCoderData]()
|
| 25 |
for ~6 epochs which amounts to 100B tokens.
|
| 26 |
|
| 27 |
|
|
|
|
| 19 |
verified: false
|
| 20 |
---
|
| 21 |
|
| 22 |
+
# TinytarCoderPy
|
| 23 |
|
| 24 |
+
This is a 159M parameters model with teh same architecture as [StarCoder](https://huggingface.co/bigcode/starcoder) (8k context length, MQA & FIM). It was trained on the Python data from [StarCoderData](https://huggingface.co/datasets/bigcode/starcoderdata)
|
| 25 |
for ~6 epochs which amounts to 100B tokens.
|
| 26 |
|
| 27 |
|