Hugging Face's logo

second-state
/
Mistral-Large-Instruct-2407-GGUF

Text Generation
Transformers
GGUF
mistral
Inference Endpoints
conversational
Model card Files Community
apepkuss79 commited on
Commit
230aa6d
•
1 Parent(s): e77c8ff

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +14 -2
README.md CHANGED
@@ -104,7 +104,19 @@ language:
104
  | [Mistral-Large-Instruct-2407-Q6_K-00002-of-00004.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q6_K-00002-of-00004.gguf) | Q6_K | 6 | 29.8 GB| very large, extremely low quality loss |
105
  | [Mistral-Large-Instruct-2407-Q6_K-00003-of-00004.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q6_K-00003-of-00004.gguf) | Q6_K | 6 | 29.8 GB| very large, extremely low quality loss |
106
  | [Mistral-Large-Instruct-2407-Q6_K-00004-of-00004.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q6_K-00004-of-00004.gguf) | Q6_K | 6 | 11.1 GB| very large, extremely low quality loss |
107
- | [Mistral-Large-Instruct-2407-Q8_0.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q8_0.gguf) | Q8_0 | 8 | 7.7 GB| very large, extremely low quality loss - not recommended |
108
- | [Mistral-Large-Instruct-2407-f16.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-f16.gguf) | f16 | 16 | 14.5 GB| |
 
 
 
 
 
 
 
 
 
 
 
 
109
 
110
  *Quantized with llama.cpp b3499.*
 
104
  | [Mistral-Large-Instruct-2407-Q6_K-00002-of-00004.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q6_K-00002-of-00004.gguf) | Q6_K | 6 | 29.8 GB| very large, extremely low quality loss |
105
  | [Mistral-Large-Instruct-2407-Q6_K-00003-of-00004.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q6_K-00003-of-00004.gguf) | Q6_K | 6 | 29.8 GB| very large, extremely low quality loss |
106
  | [Mistral-Large-Instruct-2407-Q6_K-00004-of-00004.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q6_K-00004-of-00004.gguf) | Q6_K | 6 | 11.1 GB| very large, extremely low quality loss |
107
+ | [Mistral-Large-Instruct-2407-Q8_0-00001-of-00005.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q8_0-00001-of-00005.gguf) | Q8_0 | 8 | 29.8 GB| very large, extremely low quality loss - not recommended |
108
+ | [Mistral-Large-Instruct-2407-Q8_0-00002-of-00005.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q8_0-00002-of-00005.gguf) | Q8_0 | 8 | 29.8 GB| very large, extremely low quality loss - not recommended |
109
+ | [Mistral-Large-Instruct-2407-Q8_0-00003-of-00005.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q8_0-00003-of-00005.gguf) | Q8_0 | 8 | 29.8 GB| very large, extremely low quality loss - not recommended |
110
+ | [Mistral-Large-Instruct-2407-Q8_0-00004-of-00005.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q8_0-00004-of-00005.gguf) | Q8_0 | 8 | 29.8 GB| very large, extremely low quality loss - not recommended |
111
+ | [Mistral-Large-Instruct-2407-Q8_0-00005-of-00005.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q8_0-00005-of-00005.gguf) | Q8_0 | 8 | 11.1 GB| very large, extremely low quality loss - not recommended |
112
+ | [Mistral-Large-Instruct-2407-f16-00001-of-00009.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-f16-00001-of-00009.gguf) | f16 | 16 | 29.8 GB| |
113
+ | [Mistral-Large-Instruct-2407-f16-00002-of-00009.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-f16-00002-of-00009.gguf) | f16 | 16 | 29.8 GB| |
114
+ | [Mistral-Large-Instruct-2407-f16-00003-of-00009.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-f16-00003-of-00009.gguf) | f16 | 16 | 29.7 GB| |
115
+ | [Mistral-Large-Instruct-2407-f16-00004-of-00009.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-f16-00004-of-00009.gguf) | f16 | 16 | 29.8 GB| |
116
+ | [Mistral-Large-Instruct-2407-f16-00005-of-00009.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-f16-00005-of-00009.gguf) | f16 | 16 | 29.7 GB| |
117
+ | [Mistral-Large-Instruct-2407-f16-00006-of-00009.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-f16-00006-of-00009.gguf) | f16 | 16 | 29.8 GB| |
118
+ | [Mistral-Large-Instruct-2407-f16-00007-of-00009.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-f16-00007-of-00009.gguf) | f16 | 16 | 29.7 GB| |
119
+ | [Mistral-Large-Instruct-2407-f16-00008-of-00009.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-f16-00008-of-00009.gguf) | f16 | 16 | 29.7 GB| |
120
+ | [Mistral-Large-Instruct-2407-f16-00009-of-00009.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-f16-00009-of-00009.gguf) | f16 | 16 | 7.05 GB| |
121
 
122
  *Quantized with llama.cpp b3499.*