File size: 600 Bytes
0c343ce
 
 
 
 
5fb4ac7
0c343ce
 
1
2
3
4
5
6
7
8
---
license: apache-2.0
datasets:
- EleutherAI/the_pile
---
This model is part of an intervention study done in the paper [Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling](https://arxiv.org/abs/2304.01373) where we replaced all masculine pronouns with femanine ones and retrained the model for the last 21 billion tokens. The corresponding regular model can be found [here](https://huggingface.co/EleutherAI/pythia-1.4b-deduped).

**We do not recommend using this model for any purpose other than to study the influence of gender pronouns on language model behavior.**