RoGemma2-9b-Instruct

This repository contains quantized versions of the model.

RoGemma2-9b-Instruct-Q8_0
RoGemma2-9b-Instruct-Q6_K

For the original model, please visit: OpenLLM-Ro/RoGemma2-9b-Instruct.

Uses

RoGemma2 is intented for research use in Romanian. Base models can be adapted for a variety of natural language tasks while instruction and chat tuned models are intended for assistant-like chat.

Downloads last month: 39

GGUF

Model size

9.24B params

Architecture

gemma2

6-bit

8-bit

Inference Examples

Text Generation

Unable to determine this model's library. Check the docs .

Model tree for la2ydev/RoGemma2-9b-Instruct

Base model

google/gemma-2-9b

Finetuned

google/gemma-2-9b-it

Finetuned

OpenLLM-Ro/RoGemma2-9b-Instruct

Quantized

(1)

this model