Quants of https://huggingface.co/Luni/StarDust-12b-v1

I don't have the best internet connection (or Quanting experience) so I'll leave the more special ones to the professionals aka bartowski.

Downloads last month
48
GGUF
Model size
12.2B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .