small update to fix old model size info
Browse files
README.md
CHANGED
@@ -31,13 +31,13 @@ This HuggingFace organization hosts our pre-trained models and datasets, while t
|
|
31 |
|
32 |
### **1. Pre-trained Model Suite**
|
33 |
|
34 |
-
Our complete suite of models from
|
35 |
- [**pico-decoder-tiny**](https://huggingface.co/pico-lm/pico-decoder-tiny) (11M parameters)
|
36 |
- [**pico-decoder-small**](https://huggingface.co/pico-lm/pico-decoder-small) (65M parameters)
|
37 |
- [**pico-decoder-medium**](https://huggingface.co/pico-lm/pico-decoder-medium) (181M parameters)
|
38 |
- [**pico-decoder-large**](https://huggingface.co/pico-lm/pico-decoder-large) (570M parameters)
|
39 |
|
40 |
-
> π§ **Disclaimer** These models are still under construction. The models released in this repository have been trained for 50,000 steps (corresponding to 100B tokens). Training will finalize after 200,000 steps.
|
41 |
>
|
42 |
> π§ **Coming Soon!** **pico-decoder-xl** (1B+ parameters) Watch this space or star our [GitHub repository](https://github.com/pico-lm) for updates!
|
43 |
|
|
|
31 |
|
32 |
### **1. Pre-trained Model Suite**
|
33 |
|
34 |
+
Our complete suite of models from 11M to 570M parameters trained with Pico:
|
35 |
- [**pico-decoder-tiny**](https://huggingface.co/pico-lm/pico-decoder-tiny) (11M parameters)
|
36 |
- [**pico-decoder-small**](https://huggingface.co/pico-lm/pico-decoder-small) (65M parameters)
|
37 |
- [**pico-decoder-medium**](https://huggingface.co/pico-lm/pico-decoder-medium) (181M parameters)
|
38 |
- [**pico-decoder-large**](https://huggingface.co/pico-lm/pico-decoder-large) (570M parameters)
|
39 |
|
40 |
+
> π§ **Disclaimer** These models are still under construction. The models released in this repository have been trained for 50,000 steps (corresponding to ~100B tokens). Training will finalize after 200,000 steps.
|
41 |
>
|
42 |
> π§ **Coming Soon!** **pico-decoder-xl** (1B+ parameters) Watch this space or star our [GitHub repository](https://github.com/pico-lm) for updates!
|
43 |
|