beomi
/

KoRWKV-1.5B

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Commit History

Update README.md

69e0a88

beomi commited on Jun 19, 2023

Update README.md

fe63b04

beomi commited on Jun 19, 2023

Add 1epoch model ckpt

203c84a

beomi commited on Jun 19, 2023

Add bfloat16 weight, with 4.37M step trained

28a08ea

beomi commited on Jun 15, 2023

Add safetensors (100B) ckpt

9dab3b8

beomi commited on Jun 8, 2023

Update README.md

c7290e1

beomi commited on Jun 8, 2023

Add 100B tokens ckpt

d3fd582

beomi commited on Jun 8, 2023

Update README.md

46a5e35

beomi commited on May 30, 2023

Add ~58B tokens ckpt

34bec76

beomi commited on May 30, 2023

Merge branch 'main' of https://huggingface.co/beomi/KoRWKV-1.5B

1a86367

beomi commited on May 27, 2023

Add 1.3M ckpt(= 42B tokens)

1845fad

beomi commited on May 27, 2023

Update README.md

45f13af

beomi commited on May 25, 2023

Update README.md

74f5aab

beomi commited on May 25, 2023

Add 956k step(=31.3B tokens) ckpt

8aa951c

beomi commited on May 25, 2023

RNN can extrapolate to Unlimited context

376b4bf

beomi commited on May 24, 2023

update to 810k step(~=26.5B tokens

8f704cc

beomi commited on May 24, 2023

edit weight keys

88a12b7

beomi commited on May 23, 2023

update

ed167a2

beomi commited on May 23, 2023

Add original ckpt for RWKV code

c99f77f

beomi commited on May 23, 2023

Update README.md

773fcc4

beomi commited on May 23, 2023

Merge branch 'main' of https://huggingface.co/beomi/KoRWKV-1.5B

6121b22

beomi commited on May 23, 2023

Add 635k (20.8B tokens) step ckpt

b3ac395

beomi commited on May 23, 2023

Update README.md

7496177

beomi commited on May 22, 2023

Add 15.4B tokens(470k steps)

d7b24f7

beomi commited on May 22, 2023

test

882a7f8

beomi commited on May 21, 2023

Update README.md

3503544

beomi commited on May 21, 2023

initial commit

717a5e3

beomi commited on May 21, 2023