Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
MN-12B-Inferor-v0.1-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
5b5703b
MN-12B-Inferor-v0.1-GGUF
1 contributor
History:
6 commits
MaziyarPanahi
1f54336349862685cecde86ecd37865e7838a44c56cb3ed43535315bb4fff1da
5b5703b
verified
about 1 month ago
.gitattributes
1.85 kB
1f54336349862685cecde86ecd37865e7838a44c56cb3ed43535315bb4fff1da
about 1 month ago
MN-12B-Inferor-v0.1.Q5_K_M.gguf
8.73 GB
LFS
3561dbdffd3c07b781ce87735d161e284a392169e1ef0f93c8f5192b54360c0f
about 1 month ago
MN-12B-Inferor-v0.1.Q5_K_S.gguf
8.52 GB
LFS
2e102bf2e7ed5309d8fc7746b40136ada164ec8fd19caa11bbd6b2926c253d00
about 1 month ago
MN-12B-Inferor-v0.1.Q6_K.gguf
10.1 GB
LFS
1ccd951dec6a0830c0a53149e975b120de69952f9c6f650d518f7c82716544cd
about 1 month ago
MN-12B-Inferor-v0.1.Q8_0.gguf
13 GB
LFS
8f7db558f7313de221104a6e19a41ca2745812d5ab53faba89ba88b201d51f24
about 1 month ago
MN-12B-Inferor-v0.1.fp16.gguf
24.5 GB
LFS
1f54336349862685cecde86ecd37865e7838a44c56cb3ed43535315bb4fff1da
about 1 month ago