Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
PrunaAI
/
mosaicml-mpt-7b-chat-bnb-4bit-smashed
like
1
Follow
Pruna AI
155
Text Generation
Transformers
Safetensors
mpt
pruna-ai
custom_code
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
ca8a03f
mosaicml-mpt-7b-chat-bnb-4bit-smashed
1 contributor
History:
3 commits
sharpenb
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
ca8a03f
verified
10 months ago
.gitattributes
Safe
1.52 kB
initial commit
10 months ago
README.md
Safe
5.19 kB
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
adapt_tokenizer.py
Safe
1.72 kB
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
attention.py
Safe
24.6 kB
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
blocks.py
Safe
4.04 kB
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
config.json
Safe
2.12 kB
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
configuration_mpt.py
Safe
16.4 kB
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
custom_embedding.py
Safe
292 Bytes
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
fc.py
Safe
167 Bytes
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
ffn.py
Safe
5.22 kB
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
flash_attn_triton.py
Safe
28.2 kB
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
generation_config.json
Safe
133 Bytes
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
hf_prefixlm_converter.py
Safe
10.5 kB
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
meta_init_context.py
Safe
3.96 kB
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
model.safetensors
Safe
3.74 GB
LFS
561c2ebc0192bb903ae8ac3b303d7efa0607ff65851649beb753539dd7249590
10 months ago
modeling_mpt.py
Safe
32.4 kB
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
norm.py
Safe
3.12 kB
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
param_init_fns.py
Safe
11.9 kB
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
plots.png
Safe
440 kB
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
smash_config.json
Safe
905 Bytes
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago
warnings.py
Safe
894 Bytes
b0a50a3f8cc901f6ecd22e384836a9d411ad00f39ff27c7cc3d0341bf7e70f54
10 months ago