5fa1a76
1
This allows BERT to fully use the left and right contexts to help it learn a deeper and richer representation of the inputs.
