something-else
/

rocm-rwkv

Model card Files Files and versions Community

something-else commited on Jan 3

Commit

9bcda36

•

1 Parent(s): 75ecc0d

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -8,4 +8,5 @@ tags:
 - 3B-rwkv
 ---
 3B rocm-rwkv pth record.
-- rwkv-final-chnk5.pth: 3B rocm-rwkv model trained with Slim pajama chunk1-5 and with a loss of 2.456.

 - 3B-rwkv
 ---
 3B rocm-rwkv pth record.
+- rwkv-final-chnk5.pth: 3B rocm-rwkv model trained with Slim pajama chunk1-5 and with a loss of 2.456.
+- rwkv-final-chnk17.pth: 3B rocm-rwkv model trained with Slim pajama chunk1-10 for the first epoch and an aditional training with chunk1-7 after the first epoch  and with a loss of 2.281