Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mistral-Small-Instruct-2409-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
2
Train
Use this model
8a4ef60
Mistral-Small-Instruct-2409-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
8690d7a32304278be77265f5e545764276b5ea5e42338cef35ae46bb1808d0ac
8a4ef60
verified
4 months ago
.gitattributes
2.28 kB
8690d7a32304278be77265f5e545764276b5ea5e42338cef35ae46bb1808d0ac
4 months ago
Mistral-Small-Instruct-2409.IQ1_M.gguf
5.27 GB
LFS
d97ea4a1d42c3368b208cf06cec623e9f5fb03938a279c38612d1acde7244a27
4 months ago
Mistral-Small-Instruct-2409.IQ1_S.gguf
4.83 GB
LFS
07314d8a2b5323b9d045348b779f0f5c93de26113e9320c6a2c92a80725521ac
4 months ago
Mistral-Small-Instruct-2409.IQ2_XS.gguf
6.65 GB
LFS
4325ec2cd0579937e24513e09138db858b55a686e157f87f163f9ec0797ebefe
4 months ago
Mistral-Small-Instruct-2409.IQ3_XS.gguf
9.18 GB
LFS
c27c599ce30688e70283a911239259359932f5e4c2bfce54c4267fb92906764b
4 months ago
Mistral-Small-Instruct-2409.IQ4_XS.gguf
11.9 GB
LFS
038dbb9704e27e05422b0e62878c4cba5cc4bcf528c1c3ef6e2170de97836f79
4 months ago
Mistral-Small-Instruct-2409.Q2_K.gguf
8.27 GB
LFS
09c69d43845de7bc4d3f1bbb8910d69b03b2444e206c2a086ca7b8b28e406038
4 months ago
Mistral-Small-Instruct-2409.Q3_K_L.gguf
11.7 GB
LFS
d59c868477712071137f1d10f3aeac4411d8bdc386437159bffb1e377c8b2402
4 months ago
Mistral-Small-Instruct-2409.Q3_K_M.gguf
10.8 GB
LFS
f2de7ffd39aec8dddf94b1b9c86f45f93b738fff04db543ca05c64ce4ef1af44
4 months ago
Mistral-Small-Instruct-2409.Q3_K_S.gguf
9.64 GB
LFS
72058eebd438f4bc08ee3197c32530097a37e5db2fe8eb29dd3e0b283ed81117
4 months ago
Mistral-Small-Instruct-2409.Q4_K_M.gguf
13.3 GB
LFS
8690d7a32304278be77265f5e545764276b5ea5e42338cef35ae46bb1808d0ac
4 months ago
