Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

legraphista
/
granite-20b-code-instruct-IMat-GGUF

Text Generation
GGUF
code
granite
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
Eval Results
conversational
Model card Files Files and versions Community
granite-20b-code-instruct-IMat-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 15 commits
legraphista's picture
legraphista
Upload granite-20b-code-instruct.Q5_K_S.gguf with huggingface_hub
c0b64b3 verified 12 months ago
  • .gitattributes
    1.93 kB
    Upload granite-20b-code-instruct.Q5_K_S.gguf with huggingface_hub 12 months ago
  • README.md
    11.3 kB
    Upload README.md with huggingface_hub 12 months ago
  • granite-20b-code-instruct.FP16.gguf
    40.2 GB
    LFS
    Upload granite-20b-code-instruct.FP16.gguf with huggingface_hub 12 months ago
  • granite-20b-code-instruct.Q5_K.gguf
    14.8 GB
    LFS
    Upload granite-20b-code-instruct.Q5_K.gguf with huggingface_hub 12 months ago
  • granite-20b-code-instruct.Q5_K_S.gguf
    14 GB
    LFS
    Upload granite-20b-code-instruct.Q5_K_S.gguf with huggingface_hub 12 months ago
  • granite-20b-code-instruct.Q6_K.gguf
    16.6 GB
    LFS
    Upload granite-20b-code-instruct.Q6_K.gguf with huggingface_hub 12 months ago
  • granite-20b-code-instruct.Q8_0.gguf
    21.5 GB
    LFS
    Upload granite-20b-code-instruct.Q8_0.gguf with huggingface_hub 12 months ago
  • imatrix.dat
    8.95 MB
    LFS
    Upload imatrix.dat with huggingface_hub 12 months ago
  • imatrix.dataset
    280 kB
    Upload imatrix.dataset with huggingface_hub 12 months ago
  • imatrix.log
    12.2 kB
    Upload imatrix.log with huggingface_hub 12 months ago