Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
calme-3.2-qwenloi-3b-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Files and versions Community
3
calme-3.2-qwenloi-3b-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 8 commits
MaziyarPanahi's picture
MaziyarPanahi
c594824818e46be3df1d7cdfe8b16baa97fc931c9e1b5a4743e8069361616265
99298a4 verified 9 months ago
  • .gitattributes
    2.07 kB
    c594824818e46be3df1d7cdfe8b16baa97fc931c9e1b5a4743e8069361616265 9 months ago
  • README.md
    3.02 kB
    1ce0692ac36bffb7761b6e6e7cd8890dd5612c337111acd3c4141259f7295339 9 months ago
  • calme-3.2-qwenloi-3b-GGUF_imatrix.dat
    3.36 MB
    LFS
    1ce0692ac36bffb7761b6e6e7cd8890dd5612c337111acd3c4141259f7295339 9 months ago
  • calme-3.2-qwenloi-3b.Q2_K.gguf
    1.28 GB
    LFS
    1ce0692ac36bffb7761b6e6e7cd8890dd5612c337111acd3c4141259f7295339 9 months ago
  • calme-3.2-qwenloi-3b.Q3_K_L.gguf
    1.71 GB
    LFS
    572a920127d884b43bae2fb058ca20f935b86f30882c73fbdf46bef075c086e0 9 months ago
  • calme-3.2-qwenloi-3b.Q3_K_M.gguf
    1.59 GB
    LFS
    66b11aac7fb66fa487da9357ae3402b53f786bc7605d01215297b72575a37cfd 9 months ago
  • calme-3.2-qwenloi-3b.Q4_K_M.gguf
    1.93 GB
    LFS
    47ca8c4fd6b42d5948f4378eb2482bc64645b954c99ed7b154a4f9a192a4b62b 9 months ago
  • calme-3.2-qwenloi-3b.Q5_K_M.gguf
    2.23 GB
    LFS
    c3ae855a993b856db1ff661a13b49e5bddde03f38f8a9af4f29076f74e5c2fff 9 months ago
  • calme-3.2-qwenloi-3b.Q5_K_S.gguf
    2.17 GB
    LFS
    41bcce0782a0e85d976b413318acc371c808029e071fd5c2f383d94fec50cedf 9 months ago
  • calme-3.2-qwenloi-3b.Q6_K.gguf
    2.54 GB
    LFS
    c594824818e46be3df1d7cdfe8b16baa97fc931c9e1b5a4743e8069361616265 9 months ago