Update README.md
Browse files
README.md
CHANGED
|
@@ -104,7 +104,10 @@ If it's an 8-card (GPU, 24GB)configuration, you also need to set the num_gpu par
|
|
| 104 |
|
| 105 |
The above three parameters should be set one at a time, and do not send them all to Ollama at once.
|
| 106 |
|
| 107 |
-
|
|
|
|
|
|
|
|
|
|
| 108 |
|
| 109 |
|
| 110 |
### Donation
|
|
|
|
| 104 |
|
| 105 |
The above three parameters should be set one at a time, and do not send them all to Ollama at once.
|
| 106 |
|
| 107 |
+
|
| 108 |
+
6. Q3_K_M also supports it, and it will likely need at least 12GB of memory.
|
| 109 |
+
|
| 110 |
+
7. **We will upload q2_K, q3_K_M shortly.**
|
| 111 |
|
| 112 |
|
| 113 |
### Donation
|