Hugging Face's logo

Darkhn
/
M3.2-24B-Animus-V5-Pro-GGUF

GGUF
llama.cpp
iq1-m
Model card Files
xet
Community

Buy me a coffee, or help me get that NVIDIA RTX PRO 6000 Blackwell, so i can train even more models, also taking comissions for universe specific models

M3.2-24B-Animus-V5-Pro-GGUF

GGUF model files for M3.2-24B-Animus-V5-Pro.

This repository contains GGUF models quantized using llama.cpp.

  • Base Model: M3.2-24B-Animus-V5-Pro
  • Quantization Methods Processed in this Job: Q5_K_S, IQ4_NL, IQ4_XS, IQ3_M, IQ3_S, IQ3_XS, IQ3_XXS, Q2_K_S, IQ2_S, IQ2_XS, IQ2_M, IQ2_XXS, IQ1_M
  • Importance Matrix Used: Yes

This specific upload is for the IQ1_M quantization.

Downloads last month
401
GGUF
Model size
23.6B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Darkhn/M3.2-24B-Animus-V5-Pro-GGUF

Base model

mistralai/Mistral-Small-3.1-24B-Base-2503
Finetuned
mistralai/Mistral-Small-3.2-24B-Instruct-2506
Finetuned
anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
Finetuned
Darkhn/M3.2-24B-Animus-V5-Pro
Quantized
(1)
this model

Collections including Darkhn/M3.2-24B-Animus-V5-Pro-GGUF