Edit Models filters

Model Tree

nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

41

Full-text search

Active filters: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_8.0bpw

Text Generation • Updated 23 days ago • 8

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_7.0bpw

Text Generation • Updated 23 days ago • 9

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_6.0bpw

Text Generation • Updated 23 days ago • 12

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_5.0bpw

Text Generation • Updated 23 days ago • 12

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_4.5bpw

Text Generation • Updated 23 days ago • 11

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_4.0bpw

Text Generation • Updated 23 days ago • 15

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_3.5bpw

Text Generation • Updated 23 days ago • 9

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_3.0bpw

Text Generation • Updated 23 days ago • 8

OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc

Updated 3 days ago • 20

cnfusion/Llama-3.1-Nemotron-70B-Instruct-HF-Q2-mlx

Text Generation • Updated 10 days ago • 21

backyardai/Llama-3.1-Nemotron-70B-Instruct-GGUF

Text Generation • Updated 3 days ago • 525