BlackSheep-RP-3xMoE / pytorch_model-00001-of-00004.bin

Commit History

1 Epoch of specialization with 2 experts Active instead of ALL 3 Experts Active for the MoE Research Experiment now that its performing well on the dataset without completing a single epoch yet.
6b411d0
verified

TroyDoesAI commited on

Little bit of knowledge graphs to conceptualize what we are about to teach.
ed8f326
verified

TroyDoesAI commited on

A Little Bit of Python From Today.
85c0c1f
verified

TroyDoesAI commited on

DigitalSoul is starting to show as it gets more context obedient, interesting training evaluation results.
37cfa82
verified

TroyDoesAI commited on

Half Epoch checkpoint:
f5f5f5c
verified

TroyDoesAI commited on