Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

226

Full-text search

Active filters: nvidia

mradermacher/Llama3-ChatQA-1.5-70B-GGUF

Updated May 5 • 45 • 1

mradermacher/Llama3-ChatQA-1.5-70B-i1-GGUF

Updated May 5 • 243 • 10

Sreenington/Llama-3-8B-ChatQA-AWQ

Text Generation • Updated May 5 • 16 • 2

beratcmn/Llama3-ChatQA-1.5-8B-lora

Text Generation • Updated May 3 • 4

beratcmn/Llama3-ChatQA-1.5-8B-256K

Text Generation • Updated May 3 • 30 • 6

LoneStriker/Llama3-ChatQA-1.5-70B-GGUF

Text Generation • Updated May 3 • 18 • 2

blockblockblock/Llama3-ChatQA-1.5-8B-bpw2.25-exl2

Text Generation • Updated May 3 • 8

blockblockblock/Llama3-ChatQA-1.5-8B-bpw2.5-exl2

Text Generation • Updated May 3 • 7

blockblockblock/Llama3-ChatQA-1.5-8B-bpw3-exl2

Text Generation • Updated May 3 • 9

blockblockblock/Llama3-ChatQA-1.5-8B-bpw3.5-exl2

Text Generation • Updated May 3 • 6

blockblockblock/Llama3-ChatQA-1.5-8B-bpw3.7-exl2

Text Generation • Updated May 3 • 6

MoMonir/Llama3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 3 • 1

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4-exl2

Text Generation • Updated May 3 • 6

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.2-exl2

Text Generation • Updated May 3 • 7

LoneStriker/Llama3-ChatQA-1.5-70B-2.4bpw-h6-exl2

Text Generation • Updated May 3 • 10

LoneStriker/Llama3-ChatQA-1.5-70B-3.5bpw-h6-exl2

Text Generation • Updated May 3 • 7

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.4-exl2

Text Generation • Updated May 3 • 9

LoneStriker/Llama3-ChatQA-1.5-70B-4.0bpw-h6-exl2

Text Generation • Updated May 3 • 13

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.6-exl2

Text Generation • Updated May 3 • 9

LoneStriker/Llama3-ChatQA-1.5-70B-4.65bpw-h6-exl2

Text Generation • Updated May 3 • 7

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.8-exl2

Text Generation • Updated May 3 • 8

LoneStriker/Llama3-ChatQA-1.5-70B-5.0bpw-h6-exl2

Text Generation • Updated May 3 • 8

blockblockblock/Llama3-ChatQA-1.5-8B-bpw5-exl2

Text Generation • Updated May 3 • 5

LoneStriker/Llama3-ChatQA-1.5-70B-6.0bpw-h6-exl2

Text Generation • Updated May 4 • 12

blockblockblock/Llama3-ChatQA-1.5-8B-bpw5.5-exl2

Text Generation • Updated May 3 • 8

blockblockblock/Llama3-ChatQA-1.5-8B-bpw6-exl2

Text Generation • Updated May 3 • 9

bartowski/Llama3-ChatQA-1.5-70B-GGUF

Text Generation • Updated May 4 • 206 • 9

alexcovo/Llama3-ChatQA-1.5-8B-256K-Q4_K_M-GGUF

Text Generation • Updated May 4 • 3

lmstudio-community/Llama3-ChatQA-1.5-70B-GGUF

Text Generation • Updated May 4 • 75 • 6

lmstudio-community/Llama3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 4 • 157 • 6