File size: 388 Bytes
8e1f5d0
bbb494a
4c05877
bbb494a
 
8e1f5d0
f0274df
bbb494a
 
8e1f5d0
f0274df
bbb494a
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
## CYBERT

BERT model dedicated to the domain of cyber security. The model has been trained on a corpus of high-quality cyber security and computer science text and is unlikely to work outside this domain.


##Model architecture

The model architecture used is original Roberta and tokenizer to train the corpus is Byte Level.

##Hardware

The model is trained on GPU NVIDIA-SMI 510.54