mradermacher
/

Viking-SlimSonnet-v0.2-7B-GGUF

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Viking-SlimSonnet-v0.2-7B-GGUF

1 contributor

History: 19 commits

mradermacher's picture

auto-patch README.md

0a98b71 verified 2 months ago

.gitattributes

2.62 kB

uploaded from nethype/leia 2 months ago
README.md

4.22 kB

auto-patch README.md 2 months ago
Viking-SlimSonnet-v0.2-7B.IQ3_M.gguf

3.63 GB
LFS

uploaded from nethype/leia 2 months ago
Viking-SlimSonnet-v0.2-7B.IQ3_S.gguf

3.46 GB
LFS

uploaded from nethype/leia 2 months ago
Viking-SlimSonnet-v0.2-7B.IQ3_XS.gguf

3.31 GB
LFS

uploaded from nethype/leia 2 months ago
Viking-SlimSonnet-v0.2-7B.IQ4_XS.gguf

4.2 GB
LFS

uploaded from nethype/leia 2 months ago
Viking-SlimSonnet-v0.2-7B.Q2_K.gguf

3 GB
LFS

uploaded from nethype/leia 2 months ago
Viking-SlimSonnet-v0.2-7B.Q3_K_L.gguf

4.11 GB
LFS

uploaded from nethype/leia 2 months ago
Viking-SlimSonnet-v0.2-7B.Q3_K_M.gguf

3.81 GB
LFS

uploaded from nethype/leia 2 months ago
Viking-SlimSonnet-v0.2-7B.Q3_K_S.gguf

3.46 GB
LFS

uploaded from nethype/leia 2 months ago
Viking-SlimSonnet-v0.2-7B.Q4_K_M.gguf

4.65 GB
LFS

uploaded from nethype/leia 2 months ago
Viking-SlimSonnet-v0.2-7B.Q4_K_S.gguf

4.42 GB
LFS

uploaded from nethype/leia 2 months ago
Viking-SlimSonnet-v0.2-7B.Q5_K_M.gguf

5.4 GB
LFS

uploaded from nethype/leia 2 months ago
Viking-SlimSonnet-v0.2-7B.Q5_K_S.gguf

5.27 GB
LFS

uploaded from nethype/leia 2 months ago
Viking-SlimSonnet-v0.2-7B.Q6_K.gguf

6.2 GB
LFS

uploaded from nethype/leia 2 months ago
Viking-SlimSonnet-v0.2-7B.Q8_0.gguf

8.03 GB
LFS

uploaded from nethype/leia 2 months ago
Viking-SlimSonnet-v0.2-7B.f16.gguf

15.1 GB
LFS

uploaded from nethype/leia 2 months ago