Quantized version
#5
by
Skier8402
- opened
I made a quantized model that could further allow people to run it with llama.cpp and other methods https://huggingface.co/Skier8402/InkubaLM-0.4B-Q4_K_M-GGUF. Have a good one!
How cooooooool!