GGUFs for NorLlama 3b: https://huggingface.co/NorGLM/NorLlama-3B

I don't speak Norwegian and have no clue if this model even works. I just needed something conveniently-small to test my quantizing script, and this didn't have any GGUFs yet. Seemed silly to just throw the quants away, so here they are.

Downloads last month
4
GGUF
Model size
3.07B params
Architecture
llama
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.