Edit Models filters

Inference status

Misc

compressed-tensors

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

590

Full-text search

Active filters: compressed-tensors

stan-hua/Llama-3.2-1B-Instruct-LC-SmoothQuant-RTN-W8A8

Updated about 20 hours ago

stan-hua/Llama-3.2-1B-Instruct-LC-RTN-W8A16

Updated about 20 hours ago

stan-hua/Llama-3.2-1B-Instruct-LC-SmoothQuant-RTN-W8A16

Updated about 20 hours ago

stan-hua/Meta-Llama-3.2-3B-LC-RTN-W4A16

Updated about 20 hours ago

stan-hua/Meta-Llama-3.2-3B-LC-SmoothQuant-RTN-W4A16

Updated about 20 hours ago

stan-hua/Meta-Llama-3.2-3B-LC-RTN-W8A8

Updated about 20 hours ago

stan-hua/Meta-Llama-3.2-3B-LC-SmoothQuant-RTN-W8A8

Updated about 20 hours ago

stan-hua/Meta-Llama-3.2-3B-LC-RTN-W8A16

Updated about 20 hours ago

stan-hua/Meta-Llama-3.2-3B-LC-SmoothQuant-RTN-W8A16

Updated about 20 hours ago

stan-hua/Meta-Llama-3.2-3B-Instruct-LC-RTN-W4A16

Updated about 20 hours ago

stan-hua/Meta-Llama-3.2-3B-Instruct-LC-SmoothQuant-RTN-W4A16

Updated about 20 hours ago

stan-hua/Meta-Llama-3.2-3B-Instruct-LC-RTN-W8A8

Updated about 20 hours ago

stan-hua/Meta-Llama-3.2-3B-Instruct-LC-SmoothQuant-RTN-W8A8

Updated about 20 hours ago

stan-hua/Meta-Llama-3.2-3B-Instruct-LC-RTN-W8A16

Updated about 20 hours ago

stan-hua/Meta-Llama-3.2-3B-Instruct-LC-SmoothQuant-RTN-W8A16

Updated about 19 hours ago

stan-hua/Ministral-8B-Instruct-2410-LC-SmoothQuant-RTN-W4A16

Updated about 19 hours ago

stan-hua/Ministral-8B-Instruct-2410-LC-SmoothQuant-RTN-W8A16

Updated about 19 hours ago

stan-hua/Mistral-Small-Instruct-2409-LC-SmoothQuant-RTN-W4A16

Updated about 19 hours ago

stan-hua/Mistral-Small-Instruct-2409-LC-SmoothQuant-RTN-W8A16

Updated about 18 hours ago

noneUsername/Magnum-v4-Cydonia-v1.3-22B-2-W8A8

Updated about 1 hour ago