README.md

metadata

license: apache-2.0
pipeline_tag: text-generation
library_name: gguf

GGUF quants for https://huggingface.co/GritLM/GritLM-7B

GritLM is a generative representational instruction tuned language model. It unifies text representation (embedding) and text generation into a single model achieving state-of-the-art performance on both types of tasks.

NOTE: There is an issue with getting correct embeddings using this model, which should be fixed once PR #5796 is merged.

Layers	Context	Template (Text Representation)	Template (Text Generation)
32	32768	<s><|user|> {instruction} <|embed|> {sample}	<s><|user|> {prompt} <|assistant|> {response}