# Pretrained NDT3 models

We upload 45M and 350M NDT3 checkpoints for each of 200h and 2kh pretraining.
The configs for these models are the corresponding files on `v5` [experiment branch](https://github.com/joel99/ndt3/tree/main/context_general_bci/config/exp/v5). The Weights and Biases report with pretraining curves are available [here](https://api.wandb.ai/links/joelye9/m8waz8e7).

These checkpoints are available under [cc-by-nc-4.0](https://creativecommons.org/licenses/by-nc/4.0/) license.

- 350m 200h: jg3skdsx
- 350m 2kh: 900t21lf
- 45m 2kh: l2ulo75e
- 45m 200h: 753jmg4u