TheBloke commited on
Commit
8409a53
·
1 Parent(s): cdba350

Add q6_K file in multi-part ZIP

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -52,9 +52,9 @@ They should be compatible with all current UIs and libraries that use llama.cpp,
52
 
53
  ### New k-quant methods: `q2_K, q3_K_S, q3_K_M, q3_K_L, q4_K_S, q4_K_M, q5_K_S, q6_K`
54
 
55
- These new quantisation methods are only compatible with llama.cpp as of June 6th, commit `2d43387`.
56
 
57
- They will NOT be compatible with koboldcpp, text-generation-ui, and other UIs and libraries yet. Support is expected to come over the next few days.
58
 
59
  ## Explanation of the new k-quant methods
60
 
 
52
 
53
  ### New k-quant methods: `q2_K, q3_K_S, q3_K_M, q3_K_L, q4_K_S, q4_K_M, q5_K_S, q6_K`
54
 
55
+ These new quantisation methods are compatible with llama.cpp as of June 6th, commit `2d43387`.
56
 
57
+ They are now also compatible with recent releases of text-generation-webui, KoboldCpp, llama-cpp-python and ctransformers. Other tools and libraries may or may not be compatible - check their documentation if in doubt.
58
 
59
  ## Explanation of the new k-quant methods
60