Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
autoawq
4-bit precision
text-generation-inference
AutoTrain Compatible
Inference Endpoints
custom_code
Misc with no match
Eval Results
Merge
text-embeddings-inference
8-bit precision
Carbon Emissions
Mixture of Experts
Apply filters
Models
22
Full-text search
Edit filters
Sort: Trending
Active filters:
autoawq
Clear all
hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Text Generation
•
Updated
Aug 7
•
156k
•
80
hugging-quants/gemma-2-9b-it-AWQ-INT4
Text Generation
•
Updated
1 day ago
•
87
•
2
hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4
Text Generation
•
Updated
Sep 13
•
9.07k
•
35
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation
•
Updated
Aug 7
•
429k
•
59
aari1995/germeo-7b-awq
Text Generation
•
Updated
Apr 2
•
597
•
2
kaitchup/Yi-6B-awq-4bit
Text Generation
•
Updated
Mar 21
•
7
kaitchup/Llama-3-8b-awq-4bit
Text Generation
•
Updated
Apr 29
•
9
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k
Text Generation
•
Updated
Jul 9
•
76
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GGUF
Text Generation
•
Updated
Jul 9
•
40
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GPTQ
Text Generation
•
Updated
Jul 9
•
7
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-AWQ
Text Generation
•
Updated
Jul 9
•
13
jburmeister/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Text Generation
•
Updated
Jul 25
•
4
jburmeister/Meta-Llama-3.1-405B-Instruct-AWQ-INT4
Text Generation
•
Updated
Jul 25
•
1
Kalei/Meta-Llama-3.1-70B-Instruct-AWQ-INT4-Custom
Text Generation
•
Updated
Jul 31
•
9
anhbn/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Text Generation
•
Updated
Aug 7
•
9
UCLA-EMC/Meta-Llama-3.1-8B-AWQ-INT4
Text Generation
•
Updated
Aug 30
•
34
UCLA-EMC/Meta-Llama-3.1-8B-Instruct-AWQ-INT4-32-2.17B
Text Generation
•
Updated
Aug 30
•
6
•
1
reach-vb/Meta-Llama-3.1-8B-Instruct-AWQ-INT4-fix
Text Generation
•
Updated
Aug 14
•
5
jburmeister/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation
•
Updated
Aug 21
•
5
awilliamson/Meta-Llama-3.1-70B-Instruct-AWQ
Text Generation
•
Updated
Sep 7
•
5
flowaicom/Flow-Judge-v0.1-AWQ
Text Generation
•
Updated
9 days ago
•
3.87k
•
5
hugging-quants/Mixtral-8x7B-Instruct-v0.1-AWQ-INT4
Text Generation
•
Updated
11 days ago
•
91