Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

195

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

wonjib/Llama-3.2-3B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Nov 20

wonjib/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Nov 20 • 8

Hyeopgeon/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Nov 20 • 2

KoreaVirtualReality/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 21 • 1

ShinnningPikachu/Llama-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • Updated Nov 21 • 5

GuilFV/llama3sarcastic

Updated Nov 21 • 2

matrixportal/Llama-3.2-3B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Nov 23 • 23

matrixportal/Llama-3.2-3B-Instruct-IQ3_M-GGUF

Text Generation • Updated Nov 22 • 1

matrixportal/Llama-3.2-3B-Instruct-IQ3_XXS-GGUF

Text Generation • Updated Nov 25 • 25

matrixportal/Llama-3.2-3B-Instruct-Q2_K-GGUF

Text Generation • Updated Nov 22 • 3

Maites/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated about 1 month ago • 11

espressor/meta-llama.Llama-3.2-3B-Instruct_W8A8_FP8

Text Generation • Updated 28 days ago • 23

espressor/meta-llama.Llama-3.2-3B-Instruct_W4A16

Text Generation • Updated 28 days ago • 40

espressor/meta-llama.Llama-3.2-3B-Instruct_W8A8_int8

Text Generation • Updated 28 days ago • 35

serena97/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated 25 days ago • 6

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_awq-int4-gs128-asym

Text Generation • Updated 24 days ago • 13

ericflo/Llama-3.2-3B-COTv2

Text Generation • Updated 24 days ago • 427

ericflo/Llama-3.2-3B-COTv2.1

Text Generation • Updated 24 days ago • 398

ericflo/Llama-3.2-3B-COTv2.2

Text Generation • Updated 24 days ago • 802

hainam2410/vstep_llama

Text Generation • Updated 23 days ago • 79

jwiggerthale/Llama-3.2-3B-Instruct-Q2_K-GGUF

Text Generation • Updated 24 days ago • 8

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_awq-int4-gs128-sym

Text Generation • Updated 24 days ago • 19

jwiggerthale/Llama-3.2-3B-Instruct-Q4_0-GGUF

Text Generation • Updated 24 days ago • 114

prettyvampire/poemma

Text Generation • Updated 20 days ago • 42

fractionallab/Llama-3.2-3B-Instruct-q4f16_1-MLC

Updated 22 days ago • 5

amd/Llama-3.2-3B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid

Updated 12 days ago • 15

apu20/Llama3-2_3B_dora

Text Generation • Updated 2 days ago • 9

neuralmagic-ent/Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation • Updated 15 days ago • 11

neuralmagic-ent/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated 15 days ago • 14

Boo1312/Llama-3.2-3B-original-GGUF

Text Generation • Updated 14 days ago • 34