mradermacher
/

Nexus-4x7B-IKM-MLX-GGUF

Transformers

GGUF

English

Inference Endpoints

Model card Files Files and versions Community

mradermacher commited on Mar 17

Commit

6f975fd

•

1 Parent(s): 9eb525f

auto-patch README.md

Browse files

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -28,13 +28,13 @@ more details, including on how to concatenate multi-part files.
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q2_K.gguf) | Q2_K | 9.1 |  |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.IQ3_XS.gguf) | IQ3_XS | 10.1 |  |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q3_K_S.gguf) | Q3_K_S | 10.7 |  |
-| [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.IQ3_S.gguf) | IQ3_S | 10.7 | fast, beats Q3_K* |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.IQ3_M.gguf) | IQ3_M | 10.9 |  |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q3_K_M.gguf) | Q3_K_M | 11.8 | lower quality |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q3_K_L.gguf) | Q3_K_L | 12.8 |  |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.IQ4_XS.gguf) | IQ4_XS | 13.3 |  |
-| [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q4_K_S.gguf) | Q4_K_S | 14.0 | fast, medium quality |
-| [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q4_K_M.gguf) | Q4_K_M | 14.9 | fast, medium quality |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q5_K_S.gguf) | Q5_K_S | 16.9 |  |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q5_K_M.gguf) | Q5_K_M | 17.4 |  |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q6_K.gguf) | Q6_K | 20.1 | very good quality |

 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q2_K.gguf) | Q2_K | 9.1 |  |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.IQ3_XS.gguf) | IQ3_XS | 10.1 |  |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q3_K_S.gguf) | Q3_K_S | 10.7 |  |
+| [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.IQ3_S.gguf) | IQ3_S | 10.7 | beats Q3_K* |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.IQ3_M.gguf) | IQ3_M | 10.9 |  |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q3_K_M.gguf) | Q3_K_M | 11.8 | lower quality |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q3_K_L.gguf) | Q3_K_L | 12.8 |  |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.IQ4_XS.gguf) | IQ4_XS | 13.3 |  |
+| [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q4_K_S.gguf) | Q4_K_S | 14.0 | fast, recommended |
+| [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q4_K_M.gguf) | Q4_K_M | 14.9 | fast, recommended |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q5_K_S.gguf) | Q5_K_S | 16.9 |  |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q5_K_M.gguf) | Q5_K_M | 17.4 |  |
 | [GGUF](https://huggingface.co/mradermacher/Nexus-4x7B-IKM-MLX-GGUF/resolve/main/Nexus-4x7B-IKM-MLX.Q6_K.gguf) | Q6_K | 20.1 | very good quality |