Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,8 @@ It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com
|
|
| 11 |
## Repositories available
|
| 12 |
|
| 13 |
* [4bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/gpt4-x-vicuna-13B-GPTQ).
|
|
|
|
|
|
|
| 14 |
|
| 15 |
## How to easily download and use this model in text-generation-webui
|
| 16 |
|
|
|
|
| 11 |
## Repositories available
|
| 12 |
|
| 13 |
* [4bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/gpt4-x-vicuna-13B-GPTQ).
|
| 14 |
+
* [4bit and 5bit GGML models for CPU inference](https://huggingface.co/TheBloke/gpt4-x-vicuna-13B-GGML).
|
| 15 |
+
* [float16 model in HF format for GPU inference](https://huggingface.co/TheBloke/gpt4-x-vicuna-13B-HF).
|
| 16 |
|
| 17 |
## How to easily download and use this model in text-generation-webui
|
| 18 |
|