TeeZee commited on
Commit
0624fd3
1 Parent(s): 6d2d14d

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ GGUF quants of [TeeZee/Kyllene-57B-v1.0](https://huggingface.co/TeeZee/Kyllene-57B-v1.0),
2
+ remeber to set your max context length to proper length for hardware, 4096 is fine.
3
+ Default context length is 200k so it will eat RAM or VRAM like crazy if let unchecked.