joel99 commited on
Commit
76935c4
·
1 Parent(s): 9848841

init ckpts

Browse files
753jmg4u/checkpoints/val-epoch=397-val_loss=0.4987.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74e39356e4a5099fe64aee637b4b7298ae4923d8f69daf48a7b77b02cdca8745
3
+ size 539283244
900t21lf/checkpoints/last.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2033f2c1fb58d768977d0cb3d012b41b2dac67ad92abd6010280a09b48d45bea
3
+ size 4252341708
900t21lf/checkpoints/val-epoch=289-val_loss=0.4118.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3a6698f963e203a2be329b44f3b873147a6d37709feab7e694192825e3a88bc
3
+ size 4252341708
README.md CHANGED
@@ -1,3 +1,11 @@
1
- ---
2
- license: cc-by-nc-4.0
3
- ---
 
 
 
 
 
 
 
 
 
1
+ # Pretrained NDT3 models
2
+
3
+ We upload 45M and 350M NDT3 checkpoints for each of 200h and 2kh pretraining.
4
+ The configs for these models are the corresponding files on `v5` [experiment branch](https://github.com/joel99/ndt3/tree/main/context_general_bci/config/exp/v5). The Weights and Biases report with pretraining curves are available [here](https://api.wandb.ai/links/joelye9/m8waz8e7).
5
+
6
+ These checkpoints are available under [cc-by-nc-4.0](https://creativecommons.org/licenses/by-nc/4.0/) license.
7
+
8
+ - 350m 200h: jg3skdsx
9
+ - 350m 2kh: 900t21lf
10
+ - 45m 2kh: l2ulo75e
11
+ - 45m 200h: 753jmg4u
jg3skdsx/checkpoints/last.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91c2332a03ed5f766b450a60b37e5b994b044e0d10eaa5f72e7442c14f158b7b
3
+ size 4250313676
jg3skdsx/checkpoints/val-epoch=385-val_loss=0.4961.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1fffd0d89938d92689cc23e01f79feab425c68318da2529539520bc1ba463cd
3
+ size 4250313676
l2ulo75e/checkpoints/val-epoch=254-val_loss=0.4149.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6b8eef2eeb78dd7f4c5e308bce9131cef115f9b6943e7ac90a9128629980a2e
3
+ size 541311340