Under 10b iq4_nl gguf
Collection
Under 10B GGUFs Non-linear Quantized to try on 4GiB VRAM. Leaderboard https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
•
41 items
•
Updated
•
2