phymbert
/

llama3-8b-instruct-q4_k_m-gguf

Inference Endpoints

Model card Files Files and versions Community

llama3-8b-instruct-q4_k_m-gguf / README.md

phymbert's picture

Create README.md

57fb5de verified 8 months ago

|

history blame contribute delete

126 Bytes

	---
	license: llama2
	---

	GGUF Quantum model to be used in llama.cpp after:

	https://github.com/ggerganov/llama.cpp/issues/6747