| ## CYBERT | |
| BERT model dedicated to the domain of cyber security. The model has been trained on a corpus of high-quality cyber security and computer science text and is unlikely to work outside this domain. | |
| ##Model architecture | |
| The model architecture used is original Roberta and tokenizer to train the corpus is Byte Level. | |
| ##Hardware | |
| The model is trained on GPU NVIDIA-SMI 510.54 | |