mradermacher
/

Meta-Llama-3-4B-mlp-pruned-GGUF

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3-4B-mlp-pruned-GGUF

1 contributor

History: 6 commits

mradermacher's picture

auto-patch README.md

cf4cac0 verified 18 days ago

.gitattributes

2.41 kB

uploaded from back about 2 months ago
Meta-Llama-3-4B-mlp-pruned.IQ4_XS.gguf

2.32 GB
LFS

uploaded from back about 2 months ago
Meta-Llama-3-4B-mlp-pruned.Q2_K.gguf

1.72 GB
LFS

uploaded from back about 2 months ago
Meta-Llama-3-4B-mlp-pruned.Q3_K_L.gguf

2.25 GB
LFS

uploaded from back about 2 months ago
Meta-Llama-3-4B-mlp-pruned.Q3_K_M.gguf

2.1 GB
LFS

uploaded from back about 2 months ago
Meta-Llama-3-4B-mlp-pruned.Q3_K_S.gguf

1.93 GB
LFS

uploaded from back about 2 months ago
Meta-Llama-3-4B-mlp-pruned.Q4_K_M.gguf

2.48 GB
LFS

uploaded from back about 2 months ago
Meta-Llama-3-4B-mlp-pruned.Q4_K_S.gguf

2.41 GB
LFS

uploaded from back about 2 months ago
Meta-Llama-3-4B-mlp-pruned.Q5_K_M.gguf

2.88 GB
LFS

uploaded from back about 2 months ago
Meta-Llama-3-4B-mlp-pruned.Q5_K_S.gguf

2.83 GB
LFS

uploaded from back about 2 months ago
Meta-Llama-3-4B-mlp-pruned.Q6_K.gguf

3.29 GB
LFS

uploaded from back about 2 months ago
Meta-Llama-3-4B-mlp-pruned.Q8_0.gguf

4.26 GB
LFS

uploaded from back about 2 months ago
Meta-Llama-3-4B-mlp-pruned.f16.gguf

8.02 GB
LFS

uploaded from back about 2 months ago
README.md

3.45 kB

auto-patch README.md 18 days ago