Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
MN-12B-Inferor-v0.1-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Files and versions Community
1
MN-12B-Inferor-v0.1-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 5 commits
MaziyarPanahi's picture
MaziyarPanahi
8f7db558f7313de221104a6e19a41ca2745812d5ab53faba89ba88b201d51f24
9b67891 verified 8 months ago
  • .gitattributes
    1.79 kB
    8f7db558f7313de221104a6e19a41ca2745812d5ab53faba89ba88b201d51f24 8 months ago
  • MN-12B-Inferor-v0.1.Q5_K_M.gguf
    8.73 GB
    LFS
    3561dbdffd3c07b781ce87735d161e284a392169e1ef0f93c8f5192b54360c0f 8 months ago
  • MN-12B-Inferor-v0.1.Q5_K_S.gguf
    8.52 GB
    LFS
    2e102bf2e7ed5309d8fc7746b40136ada164ec8fd19caa11bbd6b2926c253d00 8 months ago
  • MN-12B-Inferor-v0.1.Q6_K.gguf
    10.1 GB
    LFS
    1ccd951dec6a0830c0a53149e975b120de69952f9c6f650d518f7c82716544cd 8 months ago
  • MN-12B-Inferor-v0.1.Q8_0.gguf
    13 GB
    LFS
    8f7db558f7313de221104a6e19a41ca2745812d5ab53faba89ba88b201d51f24 8 months ago