Tu2003716
/

COCOM_disabled_flash_attn

Model card Files Files and versions Community

COCOM_disabled_flash_attn

Commit History

Recover

3bfe4a8
verified

Tu2003716 commited on 15 days ago

Upload modeling_cocom.py

e203c18
verified

Tu2003716 commited on 17 days ago

Upload modeling_cocom.py

e1ddb3d
verified

Tu2003716 commited on 17 days ago

custom flash attention

7ec5e50
verified

Tu2003716 commited on 17 days ago

Delete README.md

168f0b8
verified

Tu2003716 commited on 17 days ago

backup (#8)

66c9c66
verified

Plasmarine commited on 18 days ago

Remove Longformer (#7)

3458e45
verified

Plasmarine commited on 18 days ago

Linformer intergration (#6)

8546634
verified

Plasmarine commited on 18 days ago

Linformer (#5)

e6fc89b
verified

Plasmarine commited on 18 days ago

Longformer attn config (#4)

d6b992d
verified

Plasmarine commited on 18 days ago

Use Longformer (#3)

a57bc51
verified

Plasmarine commited on 19 days ago

update device_map (#1)

ea93bae
verified

Shiro2 commited on 21 days ago

temp (#2)

8d09921
verified

Shiro2 commited on 21 days ago

Upload modeling_cocom.py

00a78e8
verified

Tu2003716 commited on 21 days ago

Upload modeling_cocom.py

0706b6b
verified

Tu2003716 commited on 21 days ago

Upload modeling_cocom.py

1010809
verified

Tu2003716 commited on 21 days ago

Upload modeling_cocom.py

4e93a9e
verified

Tu2003716 commited on 21 days ago

Upload modeling_cocom.py

c2398da
verified

Tu2003716 commited on 21 days ago

Upload modeling_cocom.py

c20c109
verified

Tu2003716 commited on 21 days ago

Upload modeling_cocom.py

f07cdb3
verified

Tu2003716 commited on 21 days ago

Convert bfloat16 to float16

9af0971
verified

Tu2003716 commited on 22 days ago

Upload pretraining files

acab43c
verified

Tu2003716 commited on 22 days ago

upload bin file

e1f4967
verified

Tu2003716 commited on 22 days ago

Change flow to allow user to choose the attn type

9d3c242
verified

Tu2003716 commited on 22 days ago

Fine tuned to add key to disable flash_attn for older GPU

027ecf9
verified

Tu2003716 commited on 22 days ago

initial commit

9a5d385
verified

Tu2003716 commited on 22 days ago