Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
Qwen2.5-14B-Instruct-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Files and versions Community
2
Qwen2.5-14B-Instruct-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 8 commits
MaziyarPanahi's picture
MaziyarPanahi
5445187ee8d87cb1a5bcabba4803f0d5d07612275651abcab1f204cb1c0155e3
4a26fb3 verified 11 months ago
  • .gitattributes
    2 kB
    5445187ee8d87cb1a5bcabba4803f0d5d07612275651abcab1f204cb1c0155e3 11 months ago
  • Qwen2.5-14B-Instruct.IQ1_M.gguf
    3.87 GB
    LFS
    58921dce9808db69c818cd7ef2253c92511b450bfb753a7429c463ced1ab6ad1 11 months ago
  • Qwen2.5-14B-Instruct.IQ1_S.gguf
    3.61 GB
    LFS
    0fc28181d54f0c7a46c386019e0d243ca13e6c1a8cfa1176e31fb88c0bc0c66e 11 months ago
  • Qwen2.5-14B-Instruct.IQ2_XS.gguf
    4.7 GB
    LFS
    440e7af9efadc0cae9aaea3a2b2d2437d81f0da04f89c9daea4fa9c4ff0768f7 11 months ago
  • Qwen2.5-14B-Instruct.IQ3_XS.gguf
    6.38 GB
    LFS
    7c190992f9dfd49b8c22e7fbe87faadf151c9c81a6a55d6d04c3cd6c9c1e272d 11 months ago
  • Qwen2.5-14B-Instruct.IQ4_XS.gguf
    8.12 GB
    LFS
    08d5eb66889a053a86a0e0fc5d4502660cfbbc0536a0e9c46e8fb409dbe26f34 11 months ago
  • Qwen2.5-14B-Instruct.Q2_K.gguf
    5.77 GB
    LFS
    bd8d0650ee7da4375206c40ed1d9c545eb0628a84e5e67d5a3cc2c47ed338aa5 11 months ago
  • Qwen2.5-14B-Instruct.Q3_K_L.gguf
    7.92 GB
    LFS
    5445187ee8d87cb1a5bcabba4803f0d5d07612275651abcab1f204cb1c0155e3 11 months ago