Qwen2.5-Coder
Collection
Gaia compatible quants for Qwen2.5-Coder models.
•
4 items
•
Updated
Qwen2.5-Coder-3B-Instruct-GGUF
Original Model
Qwen/Qwen2.5-Coder-3B-Instruct
Run with Gaianet
Prompt template
prompt template: chatml
Context size
chat_ctx_size: 32000
Run with GaiaNet
Quick start: https://docs.gaianet.ai/node-guide/quick-start
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b4033
- Downloads last month
- 129
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.