Qwen1.5 GGUF - a lmstudio-ai Collection

lmstudio-ai 's Collections

MetaAI's CodeLlama - Coding Assistant LLM

Vision Models (GGUF)

Coding

Tools Use (RAG, Function Calling)

Qwen1.5 GGUF

updated Feb 5, 2024

GGUF quants for the new Qwen1.5 model (https://qwenlm.github.io/blog/qwen1.5/)

Qwen/Qwen1.5-0.5B-Chat-GGUF

Text Generation • Updated Apr 9, 2024 • 4.03k • 27

Note With 0.5B parameters, this model runs extremely fast 🏎️💨
Qwen/Qwen1.5-1.8B-Chat-GGUF

Text Generation • Updated Apr 9, 2024 • 1.26k • 17

Note A good choice for machines with modest resources
Qwen/Qwen1.5-4B-Chat-GGUF

Text Generation • Updated Apr 9, 2024 • 726 • 12

Note A good choice for machines with modest resources
Qwen/Qwen1.5-7B-Chat-GGUF

Text Generation • Updated Apr 9, 2024 • 4.14k • 65

Note Same as the version featured on LM Studio's home page
Qwen/Qwen1.5-72B-Chat-GGUF

Text Generation • Updated Apr 9, 2024 • 129 • 64

Note 72B variant. Suitable for machines with ample resources