Update README.md
Browse files
README.md
CHANGED
@@ -13,7 +13,7 @@ inference: false
|
|
13 |
---
|
14 |
# StableVicuna-13B-GGML
|
15 |
|
16 |
-
This is
|
17 |
|
18 |
It is the result of merging the deltas from the above repository with the original Llama 13B weights, and then quantising to 4bit and 5bit GGML for CPU inference using [llama.cpp](https://github.com/ggerganov/llama.cpp).
|
19 |
|
|
|
13 |
---
|
14 |
# StableVicuna-13B-GGML
|
15 |
|
16 |
+
This is GGML format quantised 4bit and 5bit models of [CarterAI's StableVicuna 13B](https://huggingface.co/CarperAI/stable-vicuna-13b-delta).
|
17 |
|
18 |
It is the result of merging the deltas from the above repository with the original Llama 13B weights, and then quantising to 4bit and 5bit GGML for CPU inference using [llama.cpp](https://github.com/ggerganov/llama.cpp).
|
19 |
|