Update README.md
Browse files
README.md
CHANGED
@@ -30,6 +30,8 @@ pygmalion-6b-dev.q5_1.bin | 4.8 GiB | 4.8 GiB
|
|
30 |
pygmalion-6b-dev.q8_0.bin | 6.5 GiB | 6.6 GiB
|
31 |
|
32 |
**Notes:**
|
|
|
|
|
33 |
- ggerganov/ggml [[8ca2c19]](https://github.com/ggerganov/ggml/tree/8ca2c19a3bb8622954d858fbf6383522684eaf34)'s gpt-j conversion script was used for conversion and quantization. First they were converted to f16 ggml files, then quantized.
|
34 |
|
35 |
The original model can be found [here](https://huggingface.co/PygmalionAI/pygmalion-6b), and the original model card can be found below.
|
|
|
30 |
pygmalion-6b-dev.q8_0.bin | 6.5 GiB | 6.6 GiB
|
31 |
|
32 |
**Notes:**
|
33 |
+
- Tested with these SillyTavern settings:
|
34 |
+

|
35 |
- ggerganov/ggml [[8ca2c19]](https://github.com/ggerganov/ggml/tree/8ca2c19a3bb8622954d858fbf6383522684eaf34)'s gpt-j conversion script was used for conversion and quantization. First they were converted to f16 ggml files, then quantized.
|
36 |
|
37 |
The original model can be found [here](https://huggingface.co/PygmalionAI/pygmalion-6b), and the original model card can be found below.
|