
π Overview
A collection of optimized GGUF quantized models derived from Qwen/Qwen2.5-Coder-14B-Instruct, providing various performance-quality tradeoffs.
π Model Variants
Variant | Use Case | Download |
---|---|---|
Q2_K | Basic text completion tasks | π₯ |
Q3_K_M | Memory-efficient quality operations | π₯ |
Q4_K_S | Balanced performance and quality | π₯ |
Q4_K_M | Balanced performance and quality | π₯ |
Q5_K_S | Enhanced quality text generation | π₯ |
Q5_K_M | Enhanced quality text generation | π₯ |
Q6_K | Superior quality outputs | π₯ |
Q8_0 | Maximum quality, production-grade results | π₯ |
π€ Contributors
Developed with β€οΈ by BlossomAI
Star βοΈ this repo if you find it valuable!
- Downloads last month
- 487
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF
Base model
Qwen/Qwen2.5-14B
Finetuned
Qwen/Qwen2.5-Coder-14B
Finetuned
Qwen/Qwen2.5-Coder-14B-Instruct