---
datasets:
- mnli
model-index:
- name: Graphcore/gptj-mnli
results: []
---

# Graphcore/gptj-mnli

## Model description

The model is a finetuned version of [EleutherAI/gpt-j-6B](https://huggingface.co/EleutherAI/gpt-j-6B) on MNLI dataset.

## Training and evaluation data

Training dataset:

Validation dataset:

## Fine-tuning procedure

Trained on a Graphcore IPU-POD64.

Command lines:

### Training hyperparameters

The following hyperparameters were used

### Framework versions

- Transformers
- Pytorch
- Datasets
- Tokenizers