MRAGU's picture
Create README.md
eb15172 verified
metadata
license: mit
language:
  - en
base_model:
  - BlossomsAI/Qwen2.5-Coder-7B-Instruct-Uncensored
tags:
  - code
  - chat
  - uncensored
Logo

πŸš€ Qwen2.5-Coder-7B-Instruct-Uncensored-GGUF

Optimized quantized models for efficient inference

πŸ“‹ Overview

A collection of optimized GGUF quantized models derived from BlossomsAI/Qwen2.5-Coder-7B-Instruct-Uncensored, providing various performance-quality tradeoffs.

πŸ’Ž Model Variants

Variant Use Case Download
Q2_K Basic text completion tasks πŸ“₯
Q3_K_M Memory-efficient quality operations πŸ“₯
Q4_K_S Balanced performance and quality πŸ“₯
Q4_K_M Balanced performance and quality πŸ“₯
Q5_K_S Enhanced quality text generation πŸ“₯
Q5_K_M Enhanced quality text generation πŸ“₯
Q6_K Superior quality outputs πŸ“₯
Q8_0 Maximum quality, production-grade results πŸ“₯

🀝 Contributors

Developed with ❀️ by BlossomAI


Star ⭐️ this repo if you find it valuable!