Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
tclf90
/
qwen2.5-72b-instruct-gptq-int3
like
0
Text Generation
Safetensors
qwen2
qwen2.5
gptq
int3
vLLM
sglang
conversational
3-bit
License:
qwen
Model card
Files
Files and versions
Community
Use this model
Edit model card
This is a mirror repo from modelscope tclf90/qwen2.5-72b-instruct-gptq-int3
This is a mirror repo from modelscope
tclf90/qwen2.5-72b-instruct-gptq-int3
Downloads last month
48
Safetensors
Model size
9.71B params
Tensor type
I32
·
FP16
·
Inference Examples
Text Generation
Unable to determine this model's library. Check the
docs
.
Model tree for
tclf90/qwen2.5-72b-instruct-gptq-int3
Base model
Qwen/Qwen2.5-72B
Finetuned
Qwen/Qwen2.5-72B-Instruct
Quantized
(
41
)
this model