MRAGU's picture
Update README.md
b15f5f5 verified
metadata
license: mit
base_model:
  - Qwen/Qwen2.5-Coder-14B-Instruct
pipeline_tag: text-generation
Logo

πŸš€ Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF

Optimized quantized models for efficient inference

πŸ“‹ Overview

A collection of optimized GGUF quantized models derived from Qwen/Qwen2.5-Coder-14B-Instruct, providing various performance-quality tradeoffs.

πŸ’Ž Model Variants

Variant Use Case Download
Q2_K Basic text completion tasks πŸ“₯
Q3_K_M Memory-efficient quality operations πŸ“₯
Q4_K_S Balanced performance and quality πŸ“₯
Q4_K_M Balanced performance and quality πŸ“₯
Q5_K_S Enhanced quality text generation πŸ“₯
Q5_K_M Enhanced quality text generation πŸ“₯
Q6_K Superior quality outputs πŸ“₯
Q8_0 Maximum quality, production-grade results πŸ“₯

🀝 Contributors

Developed with ❀️ by BlossomAI


Star ⭐️ this repo if you find it valuable!