h2o-danube2-1.8b-chat - GGUF

Model creator: H2O.ai
Original model: h2o-danube2-1.8b-chat

Description

This repo contains GGUF format model files for h2o-danube2-1.8b-chat.

Provided files

h2o-danube2-1.8b-chat-Q2_K.gguf
h2o-danube2-1.8b-chat-Q3_K_M.gguf
h2o-danube2-1.8b-chat-Q4_K_M.gguf
h2o-danube2-1.8b-chat-Q5_K_M.gguf
h2o-danube2-1.8b-chat-Q6_K.gguf

Downloads last month: 25

GGUF

Model size

1.83B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

6-bit

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API has been turned off for this model.

Model tree for aghorbani/h2o-danube2-1.8b-chat-gguf

Base model

h2oai/h2o-danube2-1.8b-chat

Quantized

(8)

this model