init ckpts
Browse files- 753jmg4u/checkpoints/val-epoch=397-val_loss=0.4987.ckpt +3 -0
- 900t21lf/checkpoints/last.ckpt +3 -0
- 900t21lf/checkpoints/val-epoch=289-val_loss=0.4118.ckpt +3 -0
- README.md +11 -3
- jg3skdsx/checkpoints/last.ckpt +3 -0
- jg3skdsx/checkpoints/val-epoch=385-val_loss=0.4961.ckpt +3 -0
- l2ulo75e/checkpoints/val-epoch=254-val_loss=0.4149.ckpt +3 -0
753jmg4u/checkpoints/val-epoch=397-val_loss=0.4987.ckpt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:74e39356e4a5099fe64aee637b4b7298ae4923d8f69daf48a7b77b02cdca8745
|
3 |
+
size 539283244
|
900t21lf/checkpoints/last.ckpt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2033f2c1fb58d768977d0cb3d012b41b2dac67ad92abd6010280a09b48d45bea
|
3 |
+
size 4252341708
|
900t21lf/checkpoints/val-epoch=289-val_loss=0.4118.ckpt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b3a6698f963e203a2be329b44f3b873147a6d37709feab7e694192825e3a88bc
|
3 |
+
size 4252341708
|
README.md
CHANGED
@@ -1,3 +1,11 @@
|
|
1 |
-
|
2 |
-
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
# Pretrained NDT3 models
|
2 |
+
|
3 |
+
We upload 45M and 350M NDT3 checkpoints for each of 200h and 2kh pretraining.
|
4 |
+
The configs for these models are the corresponding files on `v5` [experiment branch](https://github.com/joel99/ndt3/tree/main/context_general_bci/config/exp/v5). The Weights and Biases report with pretraining curves are available [here](https://api.wandb.ai/links/joelye9/m8waz8e7).
|
5 |
+
|
6 |
+
These checkpoints are available under [cc-by-nc-4.0](https://creativecommons.org/licenses/by-nc/4.0/) license.
|
7 |
+
|
8 |
+
- 350m 200h: jg3skdsx
|
9 |
+
- 350m 2kh: 900t21lf
|
10 |
+
- 45m 2kh: l2ulo75e
|
11 |
+
- 45m 200h: 753jmg4u
|
jg3skdsx/checkpoints/last.ckpt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:91c2332a03ed5f766b450a60b37e5b994b044e0d10eaa5f72e7442c14f158b7b
|
3 |
+
size 4250313676
|
jg3skdsx/checkpoints/val-epoch=385-val_loss=0.4961.ckpt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b1fffd0d89938d92689cc23e01f79feab425c68318da2529539520bc1ba463cd
|
3 |
+
size 4250313676
|
l2ulo75e/checkpoints/val-epoch=254-val_loss=0.4149.ckpt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b6b8eef2eeb78dd7f4c5e308bce9131cef115f9b6943e7ac90a9128629980a2e
|
3 |
+
size 541311340
|