Hugging Face's logo

mobiuslabsgmbh
/
Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ

Text Generation
Transformers
mixtral
Mixture of Experts
conversational
Model card Files Community
3
Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ / README.md

Commit History

Update README.md
78ace90
verified

mobicham commited on

update qmodel with gs=128
cbbc082

mobicham commited on

Update README.md
c4deccd
verified

mobicham commited on

Update README.md
d8057bb
verified

mobicham commited on

screencast
649cf7c
verified

appoose commited on

adding streaming in the example provided
9ed79d7
verified

appoose commited on

adding vram usage
48d4273
verified

appoose commited on

adding initial metrics
956a729
verified

appoose commited on

Update README.md
49119b7
verified

appoose commited on

Update README.md
3d7f303
verified

mobicham commited on

Update README.md
8c0da45
verified

mobicham commited on

initial commit
a671496
verified

mobicham commited on