README.md

metadata

title: README
emoji: 🦀
colorFrom: gray
colorTo: gray
sdk: static
pinned: false

This repository provides large language models developed by LLM-jp, a collaborative project launched in Japan.

Model Variant
Instruction models
llm-jp-13b-instruct-full-jaster-v1.0
llm-jp-13b-instruct-full-jaster-dolly-oasst-v1.0
llm-jp-13b-instruct-full-dolly-oasst-v1.0
llm-jp-13b-instruct-lora-jaster-v1.0
llm-jp-13b-instruct-lora-jaster-dolly-oasst-v1.0
llm-jp-13b-instruct-lora-dolly-oasst-v1.0

Pre-trained models
llm-jp-13b-v1.0
llm-jp-1.3b-v1.0

Checkpoints format: transformers (Megatron-DeepSpeed format available here)