File size: 936 Bytes
5fa1a76 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
There are some important advantages to taking the more difficult road in the beginning: at a later stage when comparing the original model to the Hugging Face implementation, you can verify automatically for each component individually that the corresponding component of the 🤗 Transformers implementation matches instead of relying on visual comparison via print statements it can give you some rope to decompose the big problem of porting a model into smaller problems of just porting individual components and thus structure your work better separating the model into logical meaningful components will help you to get a better overview of the model's design and thus to better understand the model at a later stage those component-by-component tests help you to ensure that no regression occurs as you continue changing your code Lysandre's integration checks for ELECTRA gives a nice example of how this can be done. |