1 Epoch of specialization with 2 experts Active instead of ALL 3 Experts Active for the MoE Research Experiment now that its performing well on the dataset without completing a single epoch yet.
6b411d0
verified
Git LFS Details
- SHA256: ddba2c3fcd660853ad62bd343cb0f587a260afd34aeeb1190350f800c27410f1
- Pointer size: 135 Bytes
- Size of remote file: 5 GB
Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.