init ckpts

753jmg4u/checkpoints/val-epoch=397-val_loss=0.4987.ckpt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:74e39356e4a5099fe64aee637b4b7298ae4923d8f69daf48a7b77b02cdca8745
+size 539283244

900t21lf/checkpoints/last.ckpt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2033f2c1fb58d768977d0cb3d012b41b2dac67ad92abd6010280a09b48d45bea
+size 4252341708

900t21lf/checkpoints/val-epoch=289-val_loss=0.4118.ckpt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b3a6698f963e203a2be329b44f3b873147a6d37709feab7e694192825e3a88bc
+size 4252341708

README.md

@@ -1,3 +1,11 @@
----
-license: cc-by-nc-4.0
----
+# Pretrained NDT3 models
+
+We upload 45M and 350M NDT3 checkpoints for each of 200h and 2kh pretraining.
+The configs for these models are the corresponding files on `v5` [experiment branch](https://github.com/joel99/ndt3/tree/main/context_general_bci/config/exp/v5). The Weights and Biases report with pretraining curves are available [here](https://api.wandb.ai/links/joelye9/m8waz8e7).
+
+These checkpoints are available under [cc-by-nc-4.0](https://creativecommons.org/licenses/by-nc/4.0/) license.
+
+- 350m 200h: jg3skdsx
+- 350m 2kh: 900t21lf
+- 45m 2kh: l2ulo75e
+- 45m 200h: 753jmg4u

jg3skdsx/checkpoints/last.ckpt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:91c2332a03ed5f766b450a60b37e5b994b044e0d10eaa5f72e7442c14f158b7b
+size 4250313676

jg3skdsx/checkpoints/val-epoch=385-val_loss=0.4961.ckpt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b1fffd0d89938d92689cc23e01f79feab425c68318da2529539520bc1ba463cd
+size 4250313676

l2ulo75e/checkpoints/val-epoch=254-val_loss=0.4149.ckpt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b6b8eef2eeb78dd7f4c5e308bce9131cef115f9b6943e7ac90a9128629980a2e
+size 541311340