File size: 528 Bytes
a838dd3
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
---
tags:
- generated_from_trainer
model-index:
- name: Graphcore/gptj-mnli
  results: []
---

# Graphcore/gptj-mnli

This model is the fine-tuned version of [EleutherAI/gpt-j-6B](https://huggingface.co/EleutherAI/gpt-j-6B) on the [MNLI dataset]()



## Fine-tuning and evaluation data


## Fine-tuning procedure

Fine tuned on a Graphcore IPU-POD64 using `popxl`

Command lines:

### Fine-tuning hyperparameters

The following hyperparameters were used:

### Framework versions

- Transformers
- Pytorch
- Datasets
- Tokenizers