Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
vptq
Misc with no match
Inference Endpoints
AutoTrain Compatible
text-generation-inference
Eval Results
Merge
4-bit precision
custom_code
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
82
Full-text search
Edit filters
Sort: Trending
Active filters:
vptq
Clear all
VPTQ-community/Llama-2-70b-hf-v16-k65536-65536-woft
Updated
Nov 18, 2024
•
7
VPTQ-community/Meta-Llama-3-70B-v16-k65536-65536-woft
Updated
Nov 18, 2024
•
5
VPTQ-community/Llama-2-7b-hf-v6-k4096-4096
Updated
Nov 18, 2024
•
8
VPTQ-community/Mistral-Large-Instruct-2407-v8-k65536-0-woft
Updated
Nov 18, 2024
•
2
VPTQ-community/Mistral-Large-Instruct-2407-v16-k65536-16384-woft
Updated
Nov 18, 2024
•
2
•
2
VPTQ-community/Mistral-Large-Instruct-2407-v8-k65536-256-woft
Updated
Nov 18, 2024
•
5
VPTQ-community/Mistral-Large-Instruct-2407-v16-k65536-65536-woft
Updated
Nov 18, 2024
•
5
•
1
VPTQ-community/Mistral-Large-Instruct-2407-v16-k65536-1024-woft
Updated
Nov 18, 2024
•
8
VPTQ-community/Meta-Llama-3.1-405B-Instruct-v8-k65536-256-woft
Updated
Nov 18, 2024
•
3
•
1
VPTQ-community/Meta-Llama-3.1-405B-Instruct-v8-k65536-65536-woft
Updated
Nov 18, 2024
•
2
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v8-k65536-256-woft
Updated
Nov 18, 2024
•
6
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v16-k65536-65536-woft
Updated
Nov 18, 2024
•
2
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v8-k65536-65536-woft
Updated
Nov 18, 2024
•
2
•
4
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v16-k65536-1024-woft
Updated
Nov 18, 2024
•
7
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v8-k65536-0-woft
Updated
Nov 18, 2024
•
3
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v16-k65536-16384-woft
Updated
Nov 18, 2024
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v16-k65536-256-woft
Updated
Nov 18, 2024
•
1
•
1
VPTQ-community/Meta-Llama-3.3-70B-Instruct-v8-k65536-256-woft
Updated
29 days ago
•
13
VPTQ-community/Meta-Llama-3.3-70B-Instruct-v16-k65536-16384-woft
Updated
29 days ago
•
6
VPTQ-community/Meta-Llama-3.3-70B-Instruct-v8-k65536-0-woft
Updated
29 days ago
•
12
VPTQ-community/Meta-Llama-3.3-70B-Instruct-v16-k65536-65536-woft
Updated
29 days ago
•
17
VPTQ-community/Meta-Llama-3.1-8B-Instruct-v12-k65536-4096-woft-vllm
Updated
about 14 hours ago
Previous
1
2
3
Next