Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
casperhansen
/
mpt-7b-8k-chat-awq
like
3
Text Generation
Transformers
PyTorch
mpt
custom_code
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
75f4cb5
mpt-7b-8k-chat-awq
1 contributor
History:
12 commits
casperhansen
Update README.md
75f4cb5
over 1 year ago
.gitattributes
Safe
1.52 kB
initial commit
over 1 year ago
README.md
Safe
2.07 kB
Update README.md
over 1 year ago
adapt_tokenizer.py
Safe
1.75 kB
MPT 7B 8K quantized
over 1 year ago
attention.py
Safe
17.7 kB
MPT 7B 8K quantized
over 1 year ago
blocks.py
Safe
2.55 kB
MPT 7B 8K quantized
over 1 year ago
config.json
Safe
1.23 kB
Set initial device to cuda:0 for faster initial loading
over 1 year ago
configuration_mpt.py
Safe
9.2 kB
MPT 7B 8K quantized
over 1 year ago
custom_embedding.py
Safe
305 Bytes
MPT 7B 8K quantized
over 1 year ago
flash_attn_triton.py
Safe
28.2 kB
MPT 7B 8K quantized
over 1 year ago
generation_config.json
Safe
121 Bytes
MPT 7B 8K quantized
over 1 year ago
hf_prefixlm_converter.py
Safe
27.2 kB
MPT 7B 8K quantized
over 1 year ago
meta_init_context.py
Safe
3.64 kB
MPT 7B 8K quantized
over 1 year ago
modeling_mpt.py
Safe
18.9 kB
MPT 7B 8K quantized
over 1 year ago
mpt-7b-8k-chat-awq-w4-g128.pt
Safe
pickle
Detected Pickle imports (4)
"torch.IntStorage"
,
"torch.HalfStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
3.76 GB
LFS
MPT 7B 8K quantized
over 1 year ago
norm.py
Safe
2.56 kB
MPT 7B 8K quantized
over 1 year ago
param_init_fns.py
Safe
12.6 kB
MPT 7B 8K quantized
over 1 year ago
pytorch_model.bin.index.json
Safe
16 kB
MPT 7B 8K quantized
over 1 year ago
special_tokens_map.json
Safe
206 Bytes
MPT 7B 8K quantized
over 1 year ago
tokenizer.json
Safe
2.11 MB
MPT 7B 8K quantized
over 1 year ago
tokenizer_config.json
Safe
237 Bytes
MPT 7B 8K quantized
over 1 year ago