---
license: apache-2.0
---

Readme yet to be done.


- Static quants of https://huggingface.co/Qwen/Qwen2-7B-Instruct at commit [41c66b0](https://huggingface.co/Qwen/Qwen2-7B-Instruct/commit/41c66b0be1c3081f13defc6bdf946c2ef240d6a6)
- Quantized by [ThiloteE](https://huggingface.co/ThiloteE) with llama.cpp commit [e09a800](https://github.com/ggerganov/llama.cpp/commit/e09a800f9a9b19c73aa78e03b4c4be8ed988f3e6)

# Notes

These quants were created with a customized configuration that have been proven to not cause visible end of string (eos) tokens during inference with [GPT4All](https://www.nomic.ai/gpt4all).
The config.json, generation_config.json and  tokenizer_config.json differ from the original configuration as can be found in the original model's repository at the time of creation of these quants.