README.md

metadata

license: llama2
language:
  - en
library_name: transformers
datasets:
  - togethercomputer/llama-instruct

LLaMA-2-7B-32K-Chat

Model Description

LLaMA-2-7B-32K-Chat is an open-source, long-context chat model finetuned from Llama-2-7B-32K over high-quality instructions and chat data. We build Llama-2-7B-32K-Chat with less than 200 lines of Python script using Together API, and we also make the recipe fully available. We hope that this can enable everyone to finetune their own version of Llama-2-7B-32K — play with Together API and give us feedback!

What's new?

Model Architecture

Training and Fine-tuning

Inference

Limitations and Bias

As with all language models, LLaMA-2-7B-32K-Chat may generate incorrect or biased content. It's important to keep this in mind when using the model.

Community

Join us on Together Discord