---
license: apache-2.0
---

> [!NOTE]
> This is a model that is assumed to perform well, but may require more testing and user feedback. Be aware, only models featured within the GUI of GPT4All, are curated and officially supported by Nomic. Use at your own risk.

# About


- Static quants of https://huggingface.co/Qwen/Qwen2-7B-Instruct at commit [41c66b0](https://huggingface.co/Qwen/Qwen2-7B-Instruct/commit/41c66b0be1c3081f13defc6bdf946c2ef240d6a6)
- Quantized by [ThiloteE](https://huggingface.co/ThiloteE) with llama.cpp commit [e09a800](https://github.com/ggerganov/llama.cpp/commit/e09a800f9a9b19c73aa78e03b4c4be8ed988f3e6)

These quants were created with a customized configuration that have been proven to not cause visible end of string (eos) tokens during inference with [GPT4All](https://www.nomic.ai/gpt4all).
The config.json, generation_config.json and  tokenizer_config.json differ from the original configuration as can be found in the original model's repository at the time of creation of these quants.