Update README.md
Browse files
README.md
CHANGED
@@ -17,8 +17,8 @@ This repo is the result of quantising to 4bit and 5bit GGML for CPU inference us
|
|
17 |
|
18 |
## Repositories available
|
19 |
|
20 |
-
* [
|
21 |
-
* [
|
22 |
* [float16 HF format model for GPU inference and further conversions](https://huggingface.co/TheBloke/Wizard-Vicuna-7B-Uncensored-HF).
|
23 |
|
24 |
## THE FILES IN MAIN BRANCH REQUIRES LATEST LLAMA.CPP (May 12th 2023 - commit b9fd7ee)!
|
|
|
17 |
|
18 |
## Repositories available
|
19 |
|
20 |
+
* [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/Wizard-Vicuna-7B-Uncensored-GPTQ).
|
21 |
+
* [4-bit, 5-bit and 8-bit GGML models for CPU (+CUDA) inference](https://huggingface.co/TheBloke/Wizard-Vicuna-7B-Uncensored-GGML).
|
22 |
* [float16 HF format model for GPU inference and further conversions](https://huggingface.co/TheBloke/Wizard-Vicuna-7B-Uncensored-HF).
|
23 |
|
24 |
## THE FILES IN MAIN BRANCH REQUIRES LATEST LLAMA.CPP (May 12th 2023 - commit b9fd7ee)!
|