Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference Providers
Select all
Replicate
SambaNova
fal
Novita
Nebius AI Studio
Fireworks
Cerebras
Together AI
Hyperbolic
HF Inference API
Misc
Reset Misc
Quantized
Inference Endpoints
Misc with no match
AutoTrain Compatible
text-generation-inference
Eval Results
Merge
4-bit precision
8-bit precision
custom_code
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
73
Full-text search
Edit filters
Sort: Trending
Active filters:
Quantized
Clear all
VPTQ-community/deepseek-r1_v_8_k_65536_mixed_mp4
Updated
17 days ago
•
12
•
2
VPTQ-community/Meta-Llama-3.1-8B-Instruct-v12-k65536-4096-woft
Updated
Jan 13
•
206
•
4
VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-65536-woft
Updated
about 1 month ago
•
18
•
1
ABX-AI/WizardLM-2-7B-GGUF-IQ-Imatrix
Updated
Apr 15, 2024
•
582
•
21
erdiari/turkish-quantized
Updated
Jun 5, 2024
•
26
•
2
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v16-k65536-32768-woft
Updated
Feb 25
•
19
VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-65536-woft
Updated
9 days ago
•
54
VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-4096-woft
Updated
8 days ago
•
45
VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-256-woft
Updated
9 days ago
•
47
VPTQ-community/Qwen2.5-72B-Instruct-v16-k65536-65536-woft
Updated
about 1 month ago
•
14
•
4
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v16-k65536-65536-woft
Updated
about 1 month ago
•
18
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v8-k65536-256-woft
Updated
about 1 month ago
•
12
•
1
VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-256-woft
Updated
9 days ago
•
20
VPTQ-community/Qwen2.5-72B-Instruct-v16-k65536-32768-woft
Updated
about 1 month ago
•
16
•
3
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v8-k32768-0-woft
Updated
about 1 month ago
•
30
•
1
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v8-k65536-65536-woft
Updated
about 1 month ago
•
23
•
2
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v8-k16384-0-woft
Updated
about 1 month ago
•
24
•
2
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v8-k65536-0-woft
Updated
about 1 month ago
•
35
•
2
SandLogicTechnologies/Llama-3.2-3B-Instruct-GGUF
Text Generation
•
Updated
Sep 26, 2024
•
22
VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-4-woft-duplicated
Updated
about 1 month ago
•
16
•
1
VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-1024-woft
Updated
Feb 25
•
8
•
1
VPTQ-community/Meta-Llama-3.1-405B-Instruct-v8-k4096-0-woft
Updated
Feb 25
•
9
•
1
VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-64-woft
Updated
Feb 25
•
23
•
3
VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k32768-32768-woft
Updated
about 1 month ago
•
19
•
1
VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-128-woft
Updated
Feb 25
•
9
•
1
VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-4-woft
Updated
about 1 month ago
•
33
•
2
VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-0-woft
Updated
about 1 month ago
•
31
•
2
VPTQ-community/Qwen2.5-72B-Instruct-v8-k512-512-woft
Updated
about 1 month ago
•
21
•
1
VPTQ-community/Qwen2.5-72B-Instruct-v8-k1024-512-woft
Updated
about 1 month ago
•
17
•
2
VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-256-woft
Updated
Feb 25
•
13
•
1
Previous
1
2
3
Next