Nexesenex
/

Meta-Llama-3.1-70b-instruct-bf16-iMat-CQ-GGUF

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3.1-70b-instruct-bf16-iMat-CQ-GGUF / README.md

Nexesenex's picture

Update README.md

8927d68 verified 6 days ago

|

history blame contribute delete

80 Bytes

metadata

license: llama3.1

IQ5_K quant requires IK_Llama.CPP or Croco.Cpp to run.