Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
Quantization
4-bit precision
AutoTrain Compatible
Inference Endpoints
text-generation-inference
Misc with no match
Eval Results
Merge
custom_code
text-embeddings-inference
8-bit precision
Carbon Emissions
Mixture of Experts
Apply filters
Models
53
Full-text search
Edit filters
Sort: Trending
Active filters:
Quantization
Clear all
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v8-k32768-0-woft
Updated
8 days ago
•
297
•
1
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v8-k65536-65536-woft
Updated
8 days ago
•
112
•
2
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v8-k16384-0-woft
Updated
8 days ago
•
49
•
2
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v8-k65536-4-woft
Updated
8 days ago
•
39
•
1
VPTQ-community/Qwen2.5-14B-Instruct-v8-k256-256-woft
Updated
8 days ago
•
50
VPTQ-community/Qwen2.5-14B-Instruct-v16-k65536-65536-woft
Updated
8 days ago
•
50
VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-256-woft
Updated
8 days ago
•
20
VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-0-woft
Updated
8 days ago
•
28
VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-65536-woft
Updated
8 days ago
•
41
VPTQ-community/Qwen2.5-7B-Instruct-v16-k65536-65536-woft
Updated
8 days ago
•
85
•
1
VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-65536-woft
Updated
8 days ago
•
32
VPTQ-community/Qwen2.5-7B-Instruct-v8-k256-256-woft
Updated
8 days ago
•
71
VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-0-woft
Updated
8 days ago
•
177
VPTQ-community/Meta-Llama-3.1-8B-Instruct-v12-k65536-4096-woft
Updated
8 days ago
•
196
•
1
VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-0-woft
Updated
8 days ago
•
141
VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-65536-woft
Updated
8 days ago
•
30
•
1
VPTQ-community/Qwen2.5-32B-Instruct-v8-k256-256-woft
Updated
8 days ago
•
28
VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-256-woft
Updated
8 days ago
•
48
•
2
VPTQ-community/Mistral-Large-Instruct-2407-v8-k65536-0-woft
Updated
3 days ago
•
8
VPTQ-community/Mistral-Large-Instruct-2407-v16-k65536-256-woft
Updated
3 days ago
VPTQ-community/Mistral-Large-Instruct-2407-v8-k65536-256-woft
Updated
3 days ago
•
6
VPTQ-community/Mistral-Large-Instruct-2407-v16-k65536-1024-woft
Updated
3 days ago
•
6
VPTQ-community/Mistral-Large-Instruct-2407-v16-k65536-4096-woft
Updated
3 days ago
•
6
Previous
1
2
Next