Hugging Face's logo

legraphista
/
Llama-3.1-Storm-8B-IMat-GGUF

Text Generation
GGUF
llama-3.1
conversational
instruction following
reasoning
function calling
mergekit
finetuning
axolotl
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
Model card Files Community
legraphista commited on
Commit
e7cec29
•
1 Parent(s): a98c67a

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -72,7 +72,7 @@ Link: [here](https://huggingface.co/legraphista/Llama-3.1-Storm-8B-IMat-GGUF/blo
72
  | Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
73
  | -------- | ---------- | --------- | ------ | ------------ | -------- |
74
  | Llama-3.1-Storm-8B.Q8_0 | Q8_0 | - | ⏳ Processing | ⚪ Static | -
75
- | Llama-3.1-Storm-8B.Q6_K | Q6_K | - | ⏳ Processing | ⚪ Static | -
76
  | Llama-3.1-Storm-8B.Q4_K | Q4_K | - | ⏳ Processing | 🟢 IMatrix | -
77
  | Llama-3.1-Storm-8B.Q3_K | Q3_K | - | ⏳ Processing | 🟢 IMatrix | -
78
  | Llama-3.1-Storm-8B.Q2_K | Q2_K | - | ⏳ Processing | 🟢 IMatrix | -
@@ -84,7 +84,7 @@ Link: [here](https://huggingface.co/legraphista/Llama-3.1-Storm-8B-IMat-GGUF/blo
84
  | Llama-3.1-Storm-8B.BF16 | BF16 | - | ⏳ Processing | ⚪ Static | -
85
  | Llama-3.1-Storm-8B.FP16 | F16 | - | ⏳ Processing | ⚪ Static | -
86
  | Llama-3.1-Storm-8B.Q8_0 | Q8_0 | - | ⏳ Processing | ⚪ Static | -
87
- | Llama-3.1-Storm-8B.Q6_K | Q6_K | - | ⏳ Processing | ⚪ Static | -
88
  | Llama-3.1-Storm-8B.Q5_K | Q5_K | - | ⏳ Processing | ⚪ Static | -
89
  | Llama-3.1-Storm-8B.Q5_K_S | Q5_K_S | - | ⏳ Processing | ⚪ Static | -
90
  | Llama-3.1-Storm-8B.Q4_K | Q4_K | - | ⏳ Processing | 🟢 IMatrix | -
 
72
  | Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
73
  | -------- | ---------- | --------- | ------ | ------------ | -------- |
74
  | Llama-3.1-Storm-8B.Q8_0 | Q8_0 | - | ⏳ Processing | ⚪ Static | -
75
+ | [Llama-3.1-Storm-8B.Q6_K.gguf](https://huggingface.co/legraphista/Llama-3.1-Storm-8B-IMat-GGUF/blob/main/Llama-3.1-Storm-8B.Q6_K.gguf) | Q6_K | 6.60GB | ✅ Available | ⚪ Static | 📦 No
76
  | Llama-3.1-Storm-8B.Q4_K | Q4_K | - | ⏳ Processing | 🟢 IMatrix | -
77
  | Llama-3.1-Storm-8B.Q3_K | Q3_K | - | ⏳ Processing | 🟢 IMatrix | -
78
  | Llama-3.1-Storm-8B.Q2_K | Q2_K | - | ⏳ Processing | 🟢 IMatrix | -
 
84
  | Llama-3.1-Storm-8B.BF16 | BF16 | - | ⏳ Processing | ⚪ Static | -
85
  | Llama-3.1-Storm-8B.FP16 | F16 | - | ⏳ Processing | ⚪ Static | -
86
  | Llama-3.1-Storm-8B.Q8_0 | Q8_0 | - | ⏳ Processing | ⚪ Static | -
87
+ | [Llama-3.1-Storm-8B.Q6_K.gguf](https://huggingface.co/legraphista/Llama-3.1-Storm-8B-IMat-GGUF/blob/main/Llama-3.1-Storm-8B.Q6_K.gguf) | Q6_K | 6.60GB | ✅ Available | ⚪ Static | 📦 No
88
  | Llama-3.1-Storm-8B.Q5_K | Q5_K | - | ⏳ Processing | ⚪ Static | -
89
  | Llama-3.1-Storm-8B.Q5_K_S | Q5_K_S | - | ⏳ Processing | ⚪ Static | -
90
  | Llama-3.1-Storm-8B.Q4_K | Q4_K | - | ⏳ Processing | 🟢 IMatrix | -