InferenceIllusionist
/

mini-magnum-12b-v1.1-iMat-GGUF

Inference Endpoints

Model card Files Files and versions Community

mini-magnum-12b-v1.1-iMat-GGUF

1 contributor

History: 8 commits

InferenceIllusionist's picture

InferenceIllusionist

Upload 2 files

a072cd7 verified 5 months ago

.gitattributes

1.96 kB

Upload 2 files 5 months ago
README.md

1.77 kB

Update README.md 5 months ago
mini-magnum-12b-v1.1-iMat-IQ4_NL.gguf

7.1 GB
LFS

Upload 2 files 5 months ago
mini-magnum-12b-v1.1-iMat-IQ4_XS.gguf

6.74 GB
LFS

Upload 2 files 5 months ago
mini-magnum-12b-v1.1-iMat-Q4_K_S.gguf

7.12 GB
LFS

Upload mini-magnum-12b-v1.1-iMat-Q4_K_S.gguf 5 months ago
mini-magnum-12b-v1.1-iMat-Q5_K_M.gguf

8.73 GB
LFS

Upload mini-magnum-12b-v1.1-iMat-Q5_K_M.gguf 5 months ago
mini-magnum-12b-v1.1-iMat-Q6_K.gguf

10.1 GB
LFS

Upload mini-magnum-12b-v1.1-iMat-Q6_K.gguf 5 months ago
mini-magnum-12b-v1.1-iMat-Q8_0.gguf

13 GB
LFS

Upload mini-magnum-12b-v1.1-iMat-Q8_0.gguf 5 months ago