Hugging Face's logo

Synthyra
/
ANKH_large

Transformers
Safetensors
t5
text-generation-inference
Inference Endpoints
Model card Files Community

Encoder only version of the ANKH large model (paper). The encoder only version is ideal for protein representation tasks.

To download 

from transformers import T5EncoderModel, AutoTokenizer

model_path = 'Synthyra/ANKH_large'
model = T5EncoderModel.from_pretrained(model_path)
tokenizer = AutoTokenizer.from_pretrained(model_path)

We are working on implementing a version of T5 based PLMs with Flex attention once learned relative position bias is supported (used in T5). Stay tuned.

Downloads last month
111
Safetensors
Model size
1.15B params
Tensor type
F32
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.

Collection including Synthyra/ANKH_large