rdiehlmartinez commited on
Commit
267696c
Β·
verified Β·
1 Parent(s): 066e23e

small update to fix old model size info

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -31,13 +31,13 @@ This HuggingFace organization hosts our pre-trained models and datasets, while t
31
 
32
  ### **1. Pre-trained Model Suite**
33
 
34
- Our complete suite of models from 10M to 500M parameters trained with Pico:
35
  - [**pico-decoder-tiny**](https://huggingface.co/pico-lm/pico-decoder-tiny) (11M parameters)
36
  - [**pico-decoder-small**](https://huggingface.co/pico-lm/pico-decoder-small) (65M parameters)
37
  - [**pico-decoder-medium**](https://huggingface.co/pico-lm/pico-decoder-medium) (181M parameters)
38
  - [**pico-decoder-large**](https://huggingface.co/pico-lm/pico-decoder-large) (570M parameters)
39
 
40
- > 🚧 **Disclaimer** These models are still under construction. The models released in this repository have been trained for 50,000 steps (corresponding to 100B tokens). Training will finalize after 200,000 steps.
41
  >
42
  > 🚧 **Coming Soon!** **pico-decoder-xl** (1B+ parameters) Watch this space or star our [GitHub repository](https://github.com/pico-lm) for updates!
43
 
 
31
 
32
  ### **1. Pre-trained Model Suite**
33
 
34
+ Our complete suite of models from 11M to 570M parameters trained with Pico:
35
  - [**pico-decoder-tiny**](https://huggingface.co/pico-lm/pico-decoder-tiny) (11M parameters)
36
  - [**pico-decoder-small**](https://huggingface.co/pico-lm/pico-decoder-small) (65M parameters)
37
  - [**pico-decoder-medium**](https://huggingface.co/pico-lm/pico-decoder-medium) (181M parameters)
38
  - [**pico-decoder-large**](https://huggingface.co/pico-lm/pico-decoder-large) (570M parameters)
39
 
40
+ > 🚧 **Disclaimer** These models are still under construction. The models released in this repository have been trained for 50,000 steps (corresponding to ~100B tokens). Training will finalize after 200,000 steps.
41
  >
42
  > 🚧 **Coming Soon!** **pico-decoder-xl** (1B+ parameters) Watch this space or star our [GitHub repository](https://github.com/pico-lm) for updates!
43