| Script for training can be found here: https://github.com/vasudevgupta7/bigbird | |
| ```python | |
| from transformers import BigBirdForQuestionAnswering | |
| epoch_0 = "4daa96c5befa9b728c47a77280ef9484377d7791" | |
| epoch_1 = "b962e30f2367cbc5e35b2c0d64faa9bad469e2e2" | |
| revision = epoch_1 | |
| model = BigBirdForQuestionAnswering.from_pretrained(model_id, revision=revision) | |
| tokenizer = BigBirdTokenizer.from_pretrained(model_id, revision=revision) | |
| ``` |