Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

duyntnet
/
granite-3.1-8b-instruct-imatrix-GGUF

Text Generation
Transformers
GGUF
English
imatrix
granite-3.1-8b-instruct
conversational
Model card Files Files and versions
xet
Community
granite-3.1-8b-instruct-imatrix-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 9 commits
duyntnet's picture
duyntnet
Upload granite-3.1-8b-instruct-IQ2_XS.gguf with huggingface_hub
f675865 verified 8 months ago
  • .gitattributes
    2.02 kB
    Upload granite-3.1-8b-instruct-IQ2_XS.gguf with huggingface_hub 8 months ago
  • README.md
    3.46 kB
    Upload README.md with huggingface_hub 8 months ago
  • granite-3.1-8b-instruct-IQ1_M.gguf
    2 GB
    xet
    Upload granite-3.1-8b-instruct-IQ1_M.gguf with huggingface_hub 8 months ago
  • granite-3.1-8b-instruct-IQ1_S.gguf
    1.84 GB
    xet
    Upload granite-3.1-8b-instruct-IQ1_S.gguf with huggingface_hub 8 months ago
  • granite-3.1-8b-instruct-IQ2_M.gguf
    2.84 GB
    xet
    Upload granite-3.1-8b-instruct-IQ2_M.gguf with huggingface_hub 8 months ago
  • granite-3.1-8b-instruct-IQ2_S.gguf
    2.62 GB
    xet
    Upload granite-3.1-8b-instruct-IQ2_S.gguf with huggingface_hub 8 months ago
  • granite-3.1-8b-instruct-IQ2_XS.gguf
    2.5 GB
    xet
    Upload granite-3.1-8b-instruct-IQ2_XS.gguf with huggingface_hub 8 months ago
  • granite-3.1-8b-instruct-Q2_K.gguf
    3.1 GB
    xet
    Upload granite-3.1-8b-instruct-Q2_K.gguf with huggingface_hub 8 months ago
  • granite-3.1-8b-instruct-Q2_K_S.gguf
    2.88 GB
    xet
    Upload granite-3.1-8b-instruct-Q2_K_S.gguf with huggingface_hub 8 months ago