Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

Ctrl+K

Ctrl+K

100 contributors

History: 28 commits

winglian's picture

update readme

3f3f561 about 2 years ago

configs
fix lora target module, require explicit flash attention, fix min logging steps, don't use adam8bit for int4, hash prepared datasets, support hf hub datasets about 2 years ago
data
WIP for axolotl trainer about 2 years ago
scripts
fix conditional check to prevent always using 4bit about 2 years ago
src
suppport for alpaca-like instruction datasets without inputs about 2 years ago
.editorconfig

186 Bytes

WIP for axolotl trainer about 2 years ago
.gitattributes

49 Bytes

make it work with pythia in the cloud about 2 years ago
.gitignore
41 Bytes

WIP for axolotl trainer about 2 years ago
README.md
2.5 kB

update readme about 2 years ago
ds_config.json
844 Bytes

deepspeed doesn't work with flash-attn, and the gpu savings w flash attn are better than the deepspeed headaches about 2 years ago
requirements.txt
231 Bytes

fix install to work with latest alpaca lora 4bit about 2 years ago
setup.py
909 Bytes

fix install to work with latest alpaca lora 4bit about 2 years ago