README.md

---
base_model: google/gemma-2-2b-jpn-it
language:
- multilingual
library_name: transformers
license: gemma
license_link: https://ai.google.dev/gemma/terms
pipeline_tag: text-generation
tags:
- nlp
- code
quantized_by: ymcki
widget:
- messages:
  - role: user
    content: Can you provide ways to eat combinations of bananas and dragonfruits?
---

Original model: https://huggingface.co/google/gemma-2-2b-jpn-it

Run them in [LM Studio](https://lmstudio.ai/)

## Prompt format

```
<|system|> {system_prompt}<|end|><|user|> {prompt}<|end|><|assistant|>
```

## Download a file (not the whole branch) from below:

| Filename | Quant type | File Size | Split | Description |
| -------- | ---------- | --------- | ----- | ----------- |
| [gemma-2-2b-jpn-it-f16.gguf](https://huggingface.co/ymcki/gemma-2-2b-jpn-it-GGUFP/blob/main/gemma-2-2b-jpn-it-f16.gguf) | f16 | 5.24GB | false | Full F16 weights. |
| [gemma-2-2b-jpn-it-Q8_0.gguf](https://huggingface.co/ymcki/gemma-2-2b-jpn-it-GGUFP/blob/main/gemma-2-2b-jpn-it-Q8_0.gguf) | Q8_0 | 2.78GB | false | Extremely high quality, *recommended*. |

## Downloading using huggingface-cli

First, make sure you have hugginface-cli installed:

```
pip install -U "huggingface_hub[cli]"
```

Then, you can target the specific file you want:

```
huggingface-cli download ymcki/gemma-2-2b-jpn-it-GGUF --include "gemma-2-2b-jpn-it-Q8_0.gguf" --local-dir ./
```

## Credits

Thank you bartowski for providing a README.md to get me started.