Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mistral-Small-Instruct-2409-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
69cdbb5
Mistral-Small-Instruct-2409-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
09c69d43845de7bc4d3f1bbb8910d69b03b2444e206c2a086ca7b8b28e406038
69cdbb5
verified
3 months ago
.gitattributes
1.97 kB
09c69d43845de7bc4d3f1bbb8910d69b03b2444e206c2a086ca7b8b28e406038
3 months ago
Mistral-Small-Instruct-2409.IQ1_M.gguf
5.27 GB
LFS
d97ea4a1d42c3368b208cf06cec623e9f5fb03938a279c38612d1acde7244a27
3 months ago
Mistral-Small-Instruct-2409.IQ1_S.gguf
4.83 GB
LFS
07314d8a2b5323b9d045348b779f0f5c93de26113e9320c6a2c92a80725521ac
3 months ago
Mistral-Small-Instruct-2409.IQ2_XS.gguf
6.65 GB
LFS
4325ec2cd0579937e24513e09138db858b55a686e157f87f163f9ec0797ebefe
3 months ago
Mistral-Small-Instruct-2409.IQ3_XS.gguf
9.18 GB
LFS
c27c599ce30688e70283a911239259359932f5e4c2bfce54c4267fb92906764b
3 months ago
Mistral-Small-Instruct-2409.IQ4_XS.gguf
11.9 GB
LFS
038dbb9704e27e05422b0e62878c4cba5cc4bcf528c1c3ef6e2170de97836f79
3 months ago
Mistral-Small-Instruct-2409.Q2_K.gguf
8.27 GB
LFS
09c69d43845de7bc4d3f1bbb8910d69b03b2444e206c2a086ca7b8b28e406038
3 months ago