Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
featherless-ai-quants
/
anthracite-org-magnum-12b-v2.5-kto-GGUF
like
1
Follow
Quants by Featherless.ai
25
Text Generation
GGUF
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
main
anthracite-org-magnum-12b-v2.5-kto-GGUF
1 contributor
History:
2 commits
m8than
Upload folder using huggingface_hub
c243e84
verified
2 months ago
.gitattributes
Safe
2.49 kB
Upload folder using huggingface_hub
2 months ago
README.md
Safe
3.41 kB
Upload folder using huggingface_hub
2 months ago
anthracite-org-magnum-12b-v2.5-kto-IQ4_XS.gguf
Safe
6.8 GB
LFS
Upload folder using huggingface_hub
2 months ago
anthracite-org-magnum-12b-v2.5-kto-Q2_K.gguf
Safe
4.79 GB
LFS
Upload folder using huggingface_hub
2 months ago
anthracite-org-magnum-12b-v2.5-kto-Q3_K_L.gguf
Safe
6.56 GB
LFS
Upload folder using huggingface_hub
2 months ago
anthracite-org-magnum-12b-v2.5-kto-Q3_K_M.gguf
Safe
6.08 GB
LFS
Upload folder using huggingface_hub
2 months ago
anthracite-org-magnum-12b-v2.5-kto-Q3_K_S.gguf
Safe
5.53 GB
LFS
Upload folder using huggingface_hub
2 months ago
anthracite-org-magnum-12b-v2.5-kto-Q4_K_M.gguf
Safe
7.48 GB
LFS
Upload folder using huggingface_hub
2 months ago
anthracite-org-magnum-12b-v2.5-kto-Q4_K_S.gguf
Safe
7.12 GB
LFS
Upload folder using huggingface_hub
2 months ago
anthracite-org-magnum-12b-v2.5-kto-Q5_K_M.gguf
Safe
8.73 GB
LFS
Upload folder using huggingface_hub
2 months ago
anthracite-org-magnum-12b-v2.5-kto-Q5_K_S.gguf
Safe
8.52 GB
LFS
Upload folder using huggingface_hub
2 months ago
anthracite-org-magnum-12b-v2.5-kto-Q6_K.gguf
Safe
10.1 GB
LFS
Upload folder using huggingface_hub
2 months ago
anthracite-org-magnum-12b-v2.5-kto-Q8_0.gguf
Safe
13 GB
LFS
Upload folder using huggingface_hub
2 months ago
featherless-quants.png
Safe
1.61 MB
LFS
Upload folder using huggingface_hub
2 months ago
