Manel
/

Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Inference Endpoints

Model card Files Files and versions Community

Llama-3.1-8B-Instruct-Q4_K_M-GGUF / README.md

Manel's picture

Create README.md

ed42a56 verified 12 days ago

|

179 Bytes

metadata

tags:
  - llama-3.1
  - llama.cpp
  - GGUF
  - Instruct

This is a converted model to GGUF from meta-llama/Llama-3.1-8B-Instruct quantized to Q4_K_M using llama.cpp library.