Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,394

Full-text search

Active filters: chat

AIFunOver/QwQ-32B-Preview-openvino-8bit

Text Generation • Updated Dec 4, 2024 • 20

AIFunOver/QwQ-32B-Preview-openvino-4bit

Text Generation • Updated Dec 4, 2024 • 12

mav23/Mistral-7B-LLM-Fraud-Detection-GGUF

Text Generation • Updated Dec 4, 2024 • 105

cgus/Qwen2.5-1.5B-Instruct-exl2

Text Generation • Updated Dec 4, 2024 • 13

BigHuggyD/Monstral-123B-v2-FP8-Dynamic

Text Generation • Updated Dec 12, 2024 • 235

tensorblock/calme-2.2-llama3.1-70b-GGUF

Text Generation • Updated Dec 5, 2024 • 17

BigHuggyD/MarsupialAI_Monstral-123B-v2_exl2_5.0bpw_h6

Text Generation • Updated Dec 9, 2024 • 204 • 2

BigHuggyD/MarsupialAI_Monstral-123B-v2_exl2_5.5bpw_h6

Text Generation • Updated Dec 9, 2024 • 35

Triangle104/magnum-v4-22b-Q4_K_S-GGUF

Text Generation • Updated Dec 5, 2024 • 5

Triangle104/magnum-v4-22b-Q4_K_M-GGUF

Text Generation • Updated Dec 5, 2024 • 6

Triangle104/magnum-v4-22b-Q5_K_S-GGUF

Text Generation • Updated Dec 5, 2024 • 8

Triangle104/magnum-v4-22b-Q5_K_M-GGUF

Text Generation • Updated Dec 5, 2024 • 30

Triangle104/magnum-v4-22b-Q6_K-GGUF

Text Generation • Updated Dec 5, 2024 • 6

Triangle104/magnum-v4-22b-Q8_0-GGUF

Text Generation • Updated Dec 5, 2024 • 12

ggnoy/Qwen2-0.5B-Instruct-Q8_0-GGUF

Text Generation • Updated Dec 5, 2024 • 46

mradermacher/Monstral-123B-v2-GGUF

Updated 28 days ago • 20

BenevolenceMessiah/QwQ-32B-Preview-Q8_0-GGUF

Updated Dec 6, 2024 • 1

mradermacher/Monstral-123B-v2-i1-GGUF

Updated Dec 6, 2024 • 204 • 1

paultimothymooney/Qwen2.5-Coder-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Dec 6, 2024 • 3

paultimothymooney/QwQ-32B-Preview-Q8_0-GGUF

Updated Dec 6, 2024

WangZeJun/my-cool-model

Text Generation • Updated Dec 6, 2024 • 15

Darkhn/Monstral-V2-123B-3.5bpw-h6-exl2

Text Generation • Updated Dec 11, 2024 • 17

zengyuxiang/QwQ-32B-Preview-Q4_K_M-GGUF

Updated Dec 6, 2024 • 3

redrix/matricide-12B-Unslop-Unleashed

Text Generation • Updated 28 days ago • 20 • 1

bartowski/Sailor2-20B-Chat-GGUF

Text Generation • Updated Dec 6, 2024 • 333

bartowski/Sailor2-8B-Chat-GGUF

Text Generation • Updated Dec 6, 2024 • 170 • 1

bartowski/Sailor2-1B-Chat-GGUF

Text Generation • Updated Dec 6, 2024 • 155 • 1

tensorblock/Llama3-70B-ShiningValiant2-GGUF

Text Generation • Updated Dec 6, 2024 • 15

tensorblock/Llama3-70B-Fireplace-GGUF

Text Generation • Updated Dec 7, 2024 • 42

tensorblock/Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1-float32-GGUF

Text Generation • Updated Dec 7, 2024 • 213