Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
GGUF quants of [TeeZee/Kyllene-57B-v1.0](https://huggingface.co/TeeZee/Kyllene-57B-v1.0),
|
2 |
+
remeber to set your max context length to proper length for hardware, 4096 is fine.
|
3 |
+
Default context length is 200k so it will eat RAM or VRAM like crazy if let unchecked.
|