|
--- |
|
tags: |
|
- generated_from_trainer |
|
model-index: |
|
- name: Graphcore/gptj-mnli |
|
results: [] |
|
--- |
|
|
|
# Graphcore/gptj-mnli |
|
|
|
This model is the fine-tuned version of [EleutherAI/gpt-j-6B](https://huggingface.co/EleutherAI/gpt-j-6B) on the [MNLI dataset]() |
|
|
|
|
|
|
|
## Fine-tuning and evaluation data |
|
|
|
|
|
## Fine-tuning procedure |
|
|
|
Fine tuned on a Graphcore IPU-POD64 using `popxl` |
|
|
|
Command lines: |
|
|
|
### Fine-tuning hyperparameters |
|
|
|
The following hyperparameters were used: |
|
|
|
### Framework versions |
|
|
|
- Transformers |
|
- Pytorch |
|
- Datasets |
|
- Tokenizers |
