Commit
•
832d626
1
Parent(s):
8ea6e8f
Update README.md
Browse files
README.md
CHANGED
|
@@ -64,3 +64,7 @@ Output:
|
|
| 64 |
- **Gradient Accumulations**: 1
|
| 65 |
- **Batch:** 16 x 4 = 64
|
| 66 |
- **Learning rate:** warmup to 1e-5 for 100 steps and then kept constant
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 64 |
- **Gradient Accumulations**: 1
|
| 65 |
- **Batch:** 16 x 4 = 64
|
| 66 |
- **Learning rate:** warmup to 1e-5 for 100 steps and then kept constant
|
| 67 |
+
|
| 68 |
+
## Community
|
| 69 |
+
|
| 70 |
+
Join us on [Together Discord](https://discord.gg/XKWR2Hz9)
|