Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,181

Full-text search

Active filters: chatml

backyardai/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 30, 2024 • 121 • 2

Ffftdtd5dtft/Hermes-3-Llama-3.1-8B-IQ1_S-GGUF

Updated Sep 4, 2024 • 52 • 1

jburmeister/Hermes-3-Llama-3.1-8B-GGUF

Updated Sep 5, 2024 • 6 • 1

dfurman/CalmeRys-78B-Orpo-v0.1

Text Generation • Updated Oct 20, 2024 • 4.09k • 64

bartowski/CalmeRys-78B-Orpo-v0.1-GGUF

Text Generation • Updated Sep 30, 2024 • 562 • 5

Gryphe/Pantheon-RP-Pure-1.6.2-22b-Small

Updated Oct 13, 2024 • 206 • 20

bartowski/Pantheon-RP-Pure-1.6.2-22b-Small-GGUF

Text Generation • Updated Oct 13, 2024 • 1.12k • 13

mradermacher/calme-2.1-qwen2.5-72b-GGUF

Updated Oct 24, 2024 • 11 • 1

mradermacher/calme-2.1-qwen2.5-72b-i1-GGUF

Updated Oct 24, 2024 • 51 • 1

justatom/Hermes-3-Llama-3.1-8B-Q8_0-GGUF

Updated Oct 25, 2024 • 1

mav23/Pentest_AI-GGUF

Updated Oct 30, 2024 • 186 • 1

mradermacher/dolphin-2.8-experiment26-7b-preview-i1-GGUF

Updated Nov 16, 2024 • 64 • 1

tensorblock/Hermes-3-Llama-3.1-70B-GGUF

Updated Dec 4, 2024 • 53 • 1

mradermacher/Novus-7b-tr_v1-GGUF

Updated Dec 7, 2024 • 27 • 1

mradermacher/Novus-7b-tr_v1-i1-GGUF

Updated Dec 7, 2024 • 9 • 1

SYNERDATA/SYNERDATA-Hermes-3-LLaMA-3.1-8b-Q8_0.GGUF

Updated Dec 9, 2024 • 7 • 1

bartowski/Hermes-3-Llama-3.2-3B-GGUF

Text Generation • Updated Dec 11, 2024 • 2.11k • 5

Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_S-GGUF

Updated Dec 11, 2024 • 18 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF

Updated Dec 11, 2024 • 26 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_S-GGUF

Updated Dec 11, 2024 • 4 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_M-GGUF

Updated Dec 12, 2024 • 16 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q6_K-GGUF

Updated Dec 12, 2024 • 13 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

Updated Dec 12, 2024 • 14 • 1

mradermacher/Llama3-OpenBioLLM-70B-GGUF

Updated about 1 month ago • 56 • 1

NikolayKozloff/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

Updated about 1 month ago • 82 • 2

mradermacher/Hermes-3-Llama-3.2-3B-GGUF

Updated about 1 month ago • 313 • 1

mradermacher/Hermes-3-Llama-3.2-3B-i1-GGUF

Updated about 1 month ago • 963 • 1

QuantFactory/Hermes-3-Llama-3.2-3B-GGUF

Updated 24 days ago • 1.31k • 3

QuantFactory/OpenHermes-Emojitron-001-GGUF

Updated 30 days ago • 617 • 2

lunahr/Hermes-3-Llama-3.2-3B-abliterated

Text Generation • Updated 30 days ago • 89 • 2