Update README.md
Browse files
README.md
CHANGED
|
@@ -1,5 +1,7 @@
|
|
| 1 |
---
|
| 2 |
license: cc-by-nc-4.0
|
|
|
|
|
|
|
| 3 |
---
|
| 4 |
|
| 5 |
# Model card for `boldgpt_small_patch10.cont`
|
|
@@ -31,3 +33,17 @@ batch["activity"] = transform(batch["activity"])
|
|
| 31 |
# output: (B, N + 1, D) predicted next patches
|
| 32 |
output, state = model(batch)
|
| 33 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: cc-by-nc-4.0
|
| 3 |
+
datasets:
|
| 4 |
+
- clane9/NSD-Flat
|
| 5 |
---
|
| 6 |
|
| 7 |
# Model card for `boldgpt_small_patch10.cont`
|
|
|
|
| 33 |
# output: (B, N + 1, D) predicted next patches
|
| 34 |
output, state = model(batch)
|
| 35 |
```
|
| 36 |
+
|
| 37 |
+
## Reproducing
|
| 38 |
+
|
| 39 |
+
- Training command:
|
| 40 |
+
|
| 41 |
+
```bash
|
| 42 |
+
torchrun --standalone --nproc_per_node=4 \
|
| 43 |
+
scripts/train.py \
|
| 44 |
+
--out_dir results \
|
| 45 |
+
--model boldgpt_small_patch10 \
|
| 46 |
+
--no_cat --shuffle --epochs 1000 --bs 512 \
|
| 47 |
+
--workers 0 --amp --compile --wandb
|
| 48 |
+
```
|
| 49 |
+
- Commit: `e0b29adc8d5b3ed2f1a555d7de4754ba96a3bb3e`
|