English 3b version?
#2
by
flygacabra
- opened
Will there be english versions for models smaller than 7b?
OK now training 3B Eng & EngAndMore :) will release tmr
Thank you! Will you do even lower too? It would be interesting to see if it can maintain decent quality at the lower sizes too.
Ok I will try 1.5B lol. Tmr.
BlinkDL
changed discussion status to
closed
1.5B is here https://huggingface.co/BlinkDL/rwkv-4-raven/blob/main/RWKV-4-Raven-1B5-v8-Eng-20230408-ctx4096.pth
And it's not too bad lol.