NON906
/

Hermes-2-Pro-Ninja-V3-GGUF

Inference Endpoints

Model card Files Files and versions Community

Hermes-2-Pro-Ninja-V3-GGUF

This is the GGUF version of NON906/Hermes-2-Pro-Ninja-V3.

Downloads last month: 476

GGUF

Model size

7.24B params

Architecture

llama

4-bit

6-bit

Inference API

Unable to determine this model's library. Check the docs .

Model tree for NON906/Hermes-2-Pro-Ninja-V3-GGUF

Base model

Local-Novel-LLM-project/Ninja-V3

Finetuned

NON906/Hermes-2-Pro-Ninja-V3

Quantized

(1)

this model