Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / tests

Ctrl+K

Ctrl+K

100 contributors

History: 24 commits

winglian's picture

add streaming dataset support for pretraining datasets

eea2731 almost 2 years ago

fixtures
fix packing so that concatenated sequences reset the attention almost 2 years ago
test_dict.py

2.96 kB

Ignore unsupported-binary-operation almost 2 years ago
test_packed_dataset.py

2.06 kB

don't worry about duplicate code here almost 2 years ago
test_prompt_tokenizers.py
1.8 kB

don't worry about duplicate code here almost 2 years ago
test_prompters.py
2.07 kB

Lint test_prompters almost 2 years ago
test_validation.py
6.3 kB

add streaming dataset support for pretraining datasets almost 2 years ago