Update README.md
Browse files
README.md
CHANGED
@@ -2,9 +2,9 @@
|
|
2 |
base_model: [deepseek-ai/DeepSeek-Coder-V2-Instruct]
|
3 |
---
|
4 |
|
5 |
-
####
|
6 |
|
7 |
-
### Theis ones uses GGML TYPE IQ_4_XS in combination with q8_0 so it runs fast and takes advantage of int8 optimizations on most nevwer server cpus.
|
8 |
### While it requirement custom code to make it is standard compatible with plain llama.cpp
|
9 |
|
10 |
```verilog
|
|
|
2 |
base_model: [deepseek-ai/DeepSeek-Coder-V2-Instruct]
|
3 |
---
|
4 |
|
5 |
+
#### Custom quantizations of deepseek-coder-v2-instruct optimized for cpu inference.
|
6 |
|
7 |
+
### Theis ones uses GGML TYPE IQ_4_XS in combination with q8_0 so it runs fast with minimal loss and takes advantage of int8 optimizations on most nevwer server cpus.
|
8 |
### While it requirement custom code to make it is standard compatible with plain llama.cpp
|
9 |
|
10 |
```verilog
|