VenusFactory Protein Language Model

This model is part of the VenusFactory platform, described in VenusFactory: A Unified Platform for Protein Engineering Data Retrieval and Language Model Fine-Tuning. VenusFactory provides a unified platform for protein engineering data retrieval and language model fine-tuning, integrating many protein-related datasets and popular PLMs.

This specific model uses a masked language modeling objective for protein sequence feature extraction.

Code and further details are available at https://github.com/tyang816/VenusFactory.