Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ikawrakow
/
mixtral-instruct-8x7b-quantized-gguf
like
22
GGUF
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
3
Deploy
Use this model
56d042f
mixtral-instruct-8x7b-quantized-gguf
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
ikawrakow
Adding k-quants
56d042f
over 1 year ago
.gitattributes
Safe
1.56 kB
Adding k-quants
over 1 year ago
README.md
Safe
28 Bytes
initial commit
over 1 year ago
mixtral-instruct-8x7b-q2k.gguf
Safe
15.4 GB
xet
Adding k-quants
over 1 year ago
mixtral-instruct-8x7b-q3k-medium.gguf
22.4 GB
xet
Adding k-quants
over 1 year ago
mixtral-instruct-8x7b-q3k-small.gguf
Safe
20.3 GB
xet
Adding k-quants
over 1 year ago
mixtral-instruct-8x7b-q4k-medium.gguf
28.4 GB
xet
Adding k-quants
over 1 year ago
mixtral-instruct-8x7b-q4k-small.gguf
Safe
32.2 GB
xet
Adding k-quants
over 1 year ago
