---
tags:
- llama-3.1
- llama.cpp
- GGUF
- Instruct
---

This is a converted model to GGUF from `meta-llama/Llama-3.1-8B-Instruct` quantized to `Q4_K_M` using `llama.cpp` library.