Hugging Face's logo

legraphista
/
Hermes-3-Llama-3.1-70B-IMat-GGUF

Text Generation
GGUF
English
Llama-3
instruct
finetune
chatml
gpt4
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card Files Community
legraphista commited on
Commit
913c492
·
verified ·
1 Parent(s): 4c5ec2b

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -73,7 +73,7 @@ Link: [here](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF
73
  | -------- | ---------- | --------- | ------ | ------------ | -------- |
74
  | [Hermes-3-Llama-3.1-70B.Q8_0/*](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF/tree/main/Hermes-3-Llama-3.1-70B.Q8_0) | Q8_0 | 74.98GB | ✅ Available | ⚪ Static | ✂ Yes
75
  | [Hermes-3-Llama-3.1-70B.Q6_K/*](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF/tree/main/Hermes-3-Llama-3.1-70B.Q6_K) | Q6_K | 57.89GB | ✅ Available | ⚪ Static | ✂ Yes
76
- | Hermes-3-Llama-3.1-70B.Q4_K | Q4_K | - | ⏳ Processing | 🟢 IMatrix | -
77
  | [Hermes-3-Llama-3.1-70B.Q3_K.gguf](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF/blob/main/Hermes-3-Llama-3.1-70B.Q3_K.gguf) | Q3_K | 34.27GB | ✅ Available | 🟢 IMatrix | 📦 No
78
  | Hermes-3-Llama-3.1-70B.Q2_K | Q2_K | - | ⏳ Processing | 🟢 IMatrix | -
79
 
@@ -87,7 +87,7 @@ Link: [here](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF
87
  | [Hermes-3-Llama-3.1-70B.Q6_K/*](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF/tree/main/Hermes-3-Llama-3.1-70B.Q6_K) | Q6_K | 57.89GB | ✅ Available | ⚪ Static | ✂ Yes
88
  | [Hermes-3-Llama-3.1-70B.Q5_K/*](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF/tree/main/Hermes-3-Llama-3.1-70B.Q5_K) | Q5_K | 49.95GB | ✅ Available | ⚪ Static | ✂ Yes
89
  | [Hermes-3-Llama-3.1-70B.Q5_K_S/*](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF/tree/main/Hermes-3-Llama-3.1-70B.Q5_K_S) | Q5_K_S | 48.66GB | ✅ Available | ⚪ Static | ✂ Yes
90
- | Hermes-3-Llama-3.1-70B.Q4_K | Q4_K | - | ⏳ Processing | 🟢 IMatrix | -
91
  | Hermes-3-Llama-3.1-70B.Q4_K_S | Q4_K_S | - | ⏳ Processing | 🟢 IMatrix | -
92
  | Hermes-3-Llama-3.1-70B.IQ4_NL | IQ4_NL | - | ⏳ Processing | 🟢 IMatrix | -
93
  | Hermes-3-Llama-3.1-70B.IQ4_XS | IQ4_XS | - | ⏳ Processing | 🟢 IMatrix | -
 
73
  | -------- | ---------- | --------- | ------ | ------------ | -------- |
74
  | [Hermes-3-Llama-3.1-70B.Q8_0/*](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF/tree/main/Hermes-3-Llama-3.1-70B.Q8_0) | Q8_0 | 74.98GB | ✅ Available | ⚪ Static | ✂ Yes
75
  | [Hermes-3-Llama-3.1-70B.Q6_K/*](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF/tree/main/Hermes-3-Llama-3.1-70B.Q6_K) | Q6_K | 57.89GB | ✅ Available | ⚪ Static | ✂ Yes
76
+ | [Hermes-3-Llama-3.1-70B.Q4_K.gguf](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF/blob/main/Hermes-3-Llama-3.1-70B.Q4_K.gguf) | Q4_K | 42.52GB | ✅ Available | 🟢 IMatrix | 📦 No
77
  | [Hermes-3-Llama-3.1-70B.Q3_K.gguf](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF/blob/main/Hermes-3-Llama-3.1-70B.Q3_K.gguf) | Q3_K | 34.27GB | ✅ Available | 🟢 IMatrix | 📦 No
78
  | Hermes-3-Llama-3.1-70B.Q2_K | Q2_K | - | ⏳ Processing | 🟢 IMatrix | -
79
 
 
87
  | [Hermes-3-Llama-3.1-70B.Q6_K/*](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF/tree/main/Hermes-3-Llama-3.1-70B.Q6_K) | Q6_K | 57.89GB | ✅ Available | ⚪ Static | ✂ Yes
88
  | [Hermes-3-Llama-3.1-70B.Q5_K/*](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF/tree/main/Hermes-3-Llama-3.1-70B.Q5_K) | Q5_K | 49.95GB | ✅ Available | ⚪ Static | ✂ Yes
89
  | [Hermes-3-Llama-3.1-70B.Q5_K_S/*](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF/tree/main/Hermes-3-Llama-3.1-70B.Q5_K_S) | Q5_K_S | 48.66GB | ✅ Available | ⚪ Static | ✂ Yes
90
+ | [Hermes-3-Llama-3.1-70B.Q4_K.gguf](https://huggingface.co/legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF/blob/main/Hermes-3-Llama-3.1-70B.Q4_K.gguf) | Q4_K | 42.52GB | ✅ Available | 🟢 IMatrix | 📦 No
91
  | Hermes-3-Llama-3.1-70B.Q4_K_S | Q4_K_S | - | ⏳ Processing | 🟢 IMatrix | -
92
  | Hermes-3-Llama-3.1-70B.IQ4_NL | IQ4_NL | - | ⏳ Processing | 🟢 IMatrix | -
93
  | Hermes-3-Llama-3.1-70B.IQ4_XS | IQ4_XS | - | ⏳ Processing | 🟢 IMatrix | -