Add q6_K file in multi-part ZIP
Browse files
README.md
CHANGED
@@ -52,9 +52,9 @@ They should be compatible with all current UIs and libraries that use llama.cpp,
|
|
52 |
|
53 |
### New k-quant methods: `q2_K, q3_K_S, q3_K_M, q3_K_L, q4_K_S, q4_K_M, q5_K_S, q6_K`
|
54 |
|
55 |
-
These new quantisation methods are
|
56 |
|
57 |
-
They
|
58 |
|
59 |
## Explanation of the new k-quant methods
|
60 |
|
|
|
52 |
|
53 |
### New k-quant methods: `q2_K, q3_K_S, q3_K_M, q3_K_L, q4_K_S, q4_K_M, q5_K_S, q6_K`
|
54 |
|
55 |
+
These new quantisation methods are compatible with llama.cpp as of June 6th, commit `2d43387`.
|
56 |
|
57 |
+
They are now also compatible with recent releases of text-generation-webui, KoboldCpp, llama-cpp-python and ctransformers. Other tools and libraries may or may not be compatible - check their documentation if in doubt.
|
58 |
|
59 |
## Explanation of the new k-quant methods
|
60 |
|