unsloth/phi-4-unsloth-bnb-4bit
Text Generation
•
Updated
•
4.34k
•
21
Unsloth 4-bit Dynamic Quants
Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit
-
-
unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 43k • 15 -
unsloth/Qwen2-VL-7B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 16.4k • 6 -
unsloth/Qwen2-VL-2B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 10.5k • 4 -
unsloth/Pixtral-12B-2409-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 4.47k • 3 -
unsloth/QwQ-32B-Preview-unsloth-bnb-4bit
Text Generation • Updated • 899 • 15 -
unsloth/Llama-3.2-11B-Vision-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 863 • 1