Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / src /axolotl /monkeypatch

Ctrl+K

Ctrl+K

100 contributors

History: 76 commits

winglian's picture

Unsloth optims for Llama (#1609)

8a1572a unverified 11 months ago

data
support for true batches with multipack (#1230) about 1 year ago
mixtral
simplify haldning for newer multipack patches so they can be added in a single place (#1270) about 1 year ago
btlm_attn_hijack_flash.py

2.32 kB

flash_attention + sample packing for stablelm 3b (#671) over 1 year ago
fastchat_conversation_turns.py

9.38 kB

adding llama3 fastchat conversation monkeypatch (#1539) 12 months ago
llama_attn_hijack_flash.py

32.2 kB

Remove seq_len arg in rotary_emb (#1443) about 1 year ago
llama_attn_hijack_xformers.py

5.54 kB

Remove seq_len arg in rotary_emb (#1443) about 1 year ago
llama_expand_mask.py

672 Bytes

support for true batches with multipack (#1230) about 1 year ago
llama_patch_multipack.py

1.1 kB

support for true batches with multipack (#1230) about 1 year ago
mistral_attn_hijack_flash.py

22.3 kB

Unsloth gradient checkpointing offload (#1528) about 1 year ago
multipack.py

2.7 kB

qwen2_moe support w multipack (#1455) about 1 year ago
relora.py

16.8 kB

fix steps check for anneal on first cycle (#1316) about 1 year ago
stablelm_attn_hijack_flash.py

15.4 kB

flash_attention + sample packing for stablelm 3b (#671) over 1 year ago
unsloth_.py

9.02 kB

Unsloth optims for Llama (#1609) 11 months ago
utils.py

8.05 kB

Add MPS support (#1264) about 1 year ago