pcuenq
/

Llama-2-7b-chat-gguf

Inference Endpoints

Model card Files Files and versions Community

16-bit gguf version of https://huggingface.co/meta-llama/Llama-2-7b-chat-hf

For quantized versions, see https://huggingface.co/models?search=thebloke/llama-2-7b-chat

Downloads last month: 5

GGUF

Model size

6.74B params

Architecture

llama

Inference API

Unable to determine this model's library. Check the docs .

Model tree for pcuenq/Llama-2-7b-chat-gguf

Base model

meta-llama/Llama-2-7b-chat-hf

Quantized

(61)

this model