GPN trained on Arabidopsis thaliana and 7 other Brassicales

See https://github.com/songlab-cal/gpn for more details.

Basic usage:

import gpn.model
from transformers import AutoModel, AutoModelForMaskedLM

model = AutoModel.from_pretrained("songlab/gpn-brassicales")
# or
model = AutoModelForMaskedLM.from_pretrained("songlab/gpn-brassicales")

Some hparams:

  • repeat_weight: 0.1
  • lr: 120k at 1e-3 + 30k cosine decay
Downloads last month
23,304
Safetensors
Model size
65.9M params
Tensor type
F32
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Dataset used to train songlab/gpn-brassicales

Collection including songlab/gpn-brassicales