rokset3's picture
Create README.md
b1c6cc2
|
raw
history blame
2.51 kB
metadata
license: llama2
model_type: llama
tags:
  - facebook
  - meta
  - pytorch
  - llama
  - llama-2

GOAT-70B-STORYTELLING model

GOAT-70B-STORYTELLING

GOAT-70B-STORYTELLING model is supervised finetuned (SFT) version of LLaMA 2 developed by GOAT.AI lab for story-writing.

GOAT-STORYTELLING-AGENT

The GOAT-70B-STORYTELLING model has been developed as an integral component within the GOAT-STORYTELLING-AGENT Framework. This framework is designed to facilitate the generation of high-quality, cohesive, and captivating narratives, including stories and books. It achieves this by utilizing inputs such as plot outlines, character profiles, their interrelationships, and other relevant details. Example is provided below.

Model description

  • Base Architecture: LLaMA 2 70B
  • License: llama2
  • Context window length: 4096 tokens

Learn more

  • Blog: TBA
  • Framework: github.com/GOAT-STORYTELLING-AGENT (TBA)

Uses

The main purpose of GOAT-70B-STORYTELLING is to generate books, novels, moviescripts and etc. as an agent in cope with our GOAT-STORYTELLING-AGENT Framework. It is specifically designed for storywriters.

Usage

Usage can be either self-hosted via transformers or used with Spaces

import torch

from transformers import AutoTokenizer, AutoModelForCausalLM

model_name = "GOAT-AI/GOAT-70B-STORYTELLING"

tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(
    model_name,
    torch_dtype=torch.bfloat16
)

Use it inside via GOAT-STORYTELLING-AGENT framework:

GOAT-STORYTELLING-AGENT code

Training dataset

Training dataset was collected via GOAT-STORYTELLING-AGENT framework and GPT-4, incorporated with opensource instruction data. We will not release the dataset.

License

GOAT-70B-STORYTELLING model is based on Meta's LLaMA-2-70b-hf, and using own datasets.

GOAT-70B-STORYTELLING model weights are available under LLAMA-2 license. Note that the GOAT-70B-STORYTELLING model weights require access to the LLaMA-2 model weighs. The GOAT-70B-STORYTELLING model is based on LLaMA-2 and should be used according to the LLaMA-2 license.

Risks and Biases

GOAT-70B-STORYTELLING model can produce factually incorrect output and should not be relied on to deliver factually accurate information. Therefore, the GOAT-70B-STORYTELLING model could possibly generate wrong, biased, or otherwise offensive outputs.