Hugging Face's logo

Spaces:
Dovakiins
/
qwerrwe
Build error

App Files Community
qwerrwe / src /axolotl /utils /trainer.py

Commit History

Switch to parallel FFD bin packing algorithm. (#1619)
367b2e8
unverified

winglian daaave commited on

Fix `total_num_steps` (#1566)
81da7d2
unverified

bofenghuang commited on

PoSE context length ext (#1567)
5294653
unverified

winglian commited on

ORPO Trainer replacement (#1551)
7d1d22f
unverified

winglian commited on

DBRX Model Support (#1462)
132eb74
unverified

winglian commited on

use locale agnostic seperator to make large nums easier to read (#1503)
da9b1a3
unverified

winglian commited on

Pretrain multipack v2 (#1470)
5aa5097
unverified

winglian commited on

Jamba (#1451)
02af082
unverified

winglian commited on

fix for accelerate env var for auto bf16, add new base image and expand torch_cuda_arch_list support (#1413)
da265dd
unverified

winglian commited on

Fix falcon tokenization step (#1441) [skip ci]
bcdc9b1
unverified

Far El winglian commited on

strip out hacky qlora-fsdp workarounds now that qlora-fsdp fixes are upstreamed (#1428)
2a1589f
unverified

winglian commited on

more fixes 20240228 (#1342) [skip ci]
0f985e1
unverified

winglian commited on

support for true batches with multipack (#1230)
00568c1
unverified

winglian commited on

report min lenght of tokenized data (#1186) [skip ci]
d85d494
unverified

winglian commited on

Phi2 multipack (#1173)
814aee6
unverified

winglian commited on

Falcon embeddings (#1149) [skip docker]
e799e08
unverified

winglian commited on

Vram fix attempt (#1164) [skip ci]
32580c1
unverified

winglian commited on

Deprecate max packed sequence len (#1141)
2ce5c0d
unverified

winglian commited on

Multipack simplify for Mixtral (#1142)
6910e6a
unverified

winglian commited on

Preprocess dataset size fix (#1131)
7570446
unverified

winglian commited on

additional logging to get maximum token length of a sequence in the dataset (#1066) [skip ci]
2f2582e
unverified

winglian commited on

Efficiently get the length of the tokenized docs (#1063)
81d3845
unverified

ricdomolm winglian commited on

RL/DPO (#935)
f243c21

winglian commited on

Fix Deepspeed loading (#950)
5ea3aa3
unverified

winglian commited on

support for mamba (#915)
40a6362
unverified

winglian commited on

Determine FSDP/deepspeed settings on device select. (#883)
71b7ea3
unverified

user735 Karl-Johan Alm winglian commited on

don't train if eval split is too small (#873)
797f3dd
unverified

winglian commited on

various bugfixes (#856)
1470650
unverified

winglian commited on

multipack w batch sampler (#795)
641e6f7
unverified

winglian commited on

use accelerate logging for zero/main loggin only
b2430ce

winglian commited on

cleanup verbosity a bit
4c834bf

winglian commited on

Threaded MultipackDistributedDataloader with prefetched samples (#759)
05bd6f1
unverified

casperhansen commited on

refactor setup trainer so we can add more hooks (#773)
6c81c61
unverified

winglian commited on

fixes for alpaca w chatml, and don't include attention_mask w mistral for flash attention (#728)
3553172
unverified

winglian commited on

Save Axolotl config as WandB artifact (#716)
490923f
unverified

Jan Philipp Harries commited on

refactor to set eval_batch_size earlier if unset, so we can warn if mismatched (#662)
2642cae
unverified

winglian commited on

Make dataset_processes configurable (#651)
9ec2077
unverified

corbt commited on

Fix(cfg): Add validation for save_strategy and eval_strategy (#633)
383f88d
unverified

Nanobit commited on

attention_mask not needed for training (#642)
e8cbf50
unverified

winglian commited on

chore(callback): Remove old peft saving code (#510)
d5f8589
unverified

Nanobit commited on

misc fixes to add gptq tests (#621)
03e5907
unverified

winglian commited on

run eval on the first step to get a baseline (#617)
2844eb2
unverified

winglian commited on

minor tweaks to simplify (#597)
31b9e0c
unverified

winglian commited on

gather/broadcast the max value of the packing efficiency automatically (#463)
b15b19e
unverified

winglian commited on

don't add position_ids for evals (#591)
ab534d7
unverified

winglian commited on

optionally configure sample packing for evals (#589)
21ec195
unverified

winglian commited on