nisten commited on
Commit
ce1c71f
·
verified ·
1 Parent(s): 7f04701

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -2,9 +2,9 @@
2
  base_model: [deepseek-ai/DeepSeek-Coder-V2-Instruct]
3
  ---
4
 
5
- #### custom quantizations of deepseek-coder-v2-instruct optimized for cpu inference.
6
 
7
- ### Theis ones uses GGML TYPE IQ_4_XS in combination with q8_0 so it runs fast and takes advantage of int8 optimizations on most nevwer server cpus.
8
  ### While it requirement custom code to make it is standard compatible with plain llama.cpp
9
 
10
  ```verilog
 
2
  base_model: [deepseek-ai/DeepSeek-Coder-V2-Instruct]
3
  ---
4
 
5
+ #### Custom quantizations of deepseek-coder-v2-instruct optimized for cpu inference.
6
 
7
+ ### Theis ones uses GGML TYPE IQ_4_XS in combination with q8_0 so it runs fast with minimal loss and takes advantage of int8 optimizations on most nevwer server cpus.
8
  ### While it requirement custom code to make it is standard compatible with plain llama.cpp
9
 
10
  ```verilog