Quantized version

#5
by Skier8402 - opened

I made a quantized model that could further allow people to run it with llama.cpp and other methods https://huggingface.co/Skier8402/InkubaLM-0.4B-Q4_K_M-GGUF. Have a good one!

Lelapa AI org

How cooooooool!

Sign up or log in to comment