KoRWKV-1.5B / pytorch_model-00002-of-00004.bin

Commit History

total 250B tokens trained
e2e327a

beomi commited on

Add 1.5B release model (trained with 2048 batch)
b7032b9

beomi commited on

Add 1epoch model ckpt
203c84a

beomi commited on

Add bfloat16 weight, with 4.37M step trained
28a08ea

beomi commited on