Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

akswelh
/

NEOX

Model card Files Files and versions

NEOX / tools /datasets

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

akswelh's picture

Upload 251 files

d90b3a8 verified 10 months ago

README.md

8.02 kB

Upload 251 files 10 months ago
corpora.py

10.8 kB

Upload 251 files 10 months ago
dataset_token_count.py

876 Bytes

Upload 251 files 10 months ago
merge_datasets.py

2.32 kB

Upload 251 files 10 months ago
multinode_prepare_data.sh

2.31 kB

Upload 251 files 10 months ago
preprocess_data.py

7.74 kB

Upload 251 files 10 months ago
preprocess_data_with_chat_template.py

14.8 kB

Upload 251 files 10 months ago
preprocess_data_with_mask.py

12.6 kB

Upload 251 files 10 months ago