Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Qwen
/
Qwen2-72B-Instruct-GGUF
like
30
Follow
Qwen
9.36k
Text Generation
GGUF
English
instruct
chat
Inference Endpoints
imatrix
conversational
License:
other
Model card
Files
Files and versions
Community
2
Deploy
Use this model
4a76b3d
Qwen2-72B-Instruct-GGUF
5 contributors
History:
7 commits
JustinLin610
Upload qwen2-72b-instruct-q4_k_m.gguf with huggingface_hub
4a76b3d
verified
7 months ago
.gitattributes
Safe
1.56 kB
Upload files
7 months ago
LICENSE
Safe
11.3 kB
Upload files
7 months ago
README.md
Safe
2.44 kB
Update README.md
7 months ago
qwen2-72b-instruct-iq1_m.gguf
Safe
23.7 GB
LFS
Upload qwen2-72b-instruct-iq1_m.gguf with huggingface_hub
7 months ago
qwen2-72b-instruct-q4_k_m.gguf
Safe
47.4 GB
LFS
Upload qwen2-72b-instruct-q4_k_m.gguf with huggingface_hub
7 months ago
qwen2-72b-instruct-q5_0-split-00001-of-00002.gguf
Safe
26.7 GB
LFS
Upload files
7 months ago
qwen2-72b-instruct-q5_0-split-00002-of-00002.gguf
Safe
23.6 GB
LFS
Upload files
7 months ago
qwen2-72b-instruct-q5_k_m-split-00001-of-00002.gguf
Safe
26.7 GB
LFS
Upload files
7 months ago
qwen2-72b-instruct-q5_k_m-split-00002-of-00002.gguf
Safe
25 GB
LFS
Upload files
7 months ago
qwen2-72b-instruct-q6_k-split-00001-of-00002.gguf
Safe
32.1 GB
LFS
Upload files
7 months ago
qwen2-72b-instruct-q6_k-split-00002-of-00002.gguf
Safe
27.8 GB
LFS
Upload files
7 months ago
qwen2-72b-instruct-q8_0-split-00001-of-00002.gguf
Safe
39.7 GB
LFS
Upload files
7 months ago
qwen2-72b-instruct-q8_0-split-00002-of-00002.gguf
37.8 GB
LFS
Upload files
7 months ago