GGUF Quants for: MicroThinker-1B-Preview
Model by: huihui-ai (thank you!)
Quants by: quantflex
Run with llama.cpp:
./llama-cli -m MicroThinker-1B-Preview-Q5_K_M.gguf -cnv -p "You are a helpful assistant. You should think step-by-step." --chat-template llama3
- Downloads last month
- 49
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for quantflex/MicroThinker-1B-Preview-GGUF
Base model
meta-llama/Llama-3.2-1B-Instruct
Finetuned
huihui-ai/MicroThinker-1B-Preview