Manel
/

Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Inference Endpoints

Model card Files Files and versions Community

Llama-3.1-8B-Instruct-Q4_K_M-GGUF / README.md

Manel's picture

Create README.md

ed42a56 verified 13 days ago

|

179 Bytes

	---
	tags:
	- llama-3.1
	- llama.cpp
	- GGUF
	- Instruct
	---

	This is a converted model to GGUF from `meta-llama/Llama-3.1-8B-Instruct` quantized to `Q4_K_M` using `llama.cpp` library.