eachadea
/

ggml-vicuna-13b-1.1

Document Question Answering

Model card Files Files and versions Community

eachadea commited on Apr 19, 2023

Commit

f701348

•

1 Parent(s): f2c2e2d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -12,7 +12,7 @@ inference: false
 - For q4_2, "Q4_2 ARM #1046" was used. Will update regularly if new changes are made.
 - **Choosing between q4_0, q4_1, and q4_2:**
   - 4_0 is the fastest. The quality is the poorest.
-  - 4_1 is a lot slower. The quality is noticably better.
   - 4_2 is almost as fast as 4_0 and about as good as 4_1 **on Apple Silicon**. On Intel/AMD it's hardly better or faster than 4_1.
 - 7B version of this can be found here: https://huggingface.co/eachadea/ggml-vicuna-7b-1.1

 - For q4_2, "Q4_2 ARM #1046" was used. Will update regularly if new changes are made.
 - **Choosing between q4_0, q4_1, and q4_2:**
   - 4_0 is the fastest. The quality is the poorest.
+  - 4_1 is a lot slower. The quality is noticeably better.
   - 4_2 is almost as fast as 4_0 and about as good as 4_1 **on Apple Silicon**. On Intel/AMD it's hardly better or faster than 4_1.
 - 7B version of this can be found here: https://huggingface.co/eachadea/ggml-vicuna-7b-1.1