hdallatorre
commited on
Commit
·
789373e
1
Parent(s):
616ac86
Update README.md
Browse files
README.md
CHANGED
@@ -13,7 +13,7 @@ datasets:
|
|
13 |
|
14 |
The Nucleotide Transformers are a collection of foundational language models that were pre-trained on DNA sequences from whole-genomes. Compared to other approaches, our models do not only integrate information from single reference genomes, but leverage DNA sequences from over 3,200 diverse human genomes, as well as 850 genomes from a wide range of species, including model and non-model organisms. Through robust and extensive evaluation, we show that these large models provide extremely accurate molecular phenotype prediction compared to existing methods
|
15 |
|
16 |
-
Part of this collection is the **nucleotide-transformer-500m-human-ref**, a 500M parameters transformer pre-trained on the human reference genome. The model is available both in Tensorflow and Pytorch.
|
17 |
|
18 |
**Developed by:** InstaDeep, NVIDIA and TUM
|
19 |
|
@@ -27,6 +27,12 @@ Part of this collection is the **nucleotide-transformer-500m-human-ref**, a 500M
|
|
27 |
### How to use
|
28 |
|
29 |
<!-- Need to adapt this section to our model. Need to figure out how to load the models from huggingface and do inference on them -->
|
|
|
|
|
|
|
|
|
|
|
|
|
30 |
```python
|
31 |
from transformers import AutoTokenizer, AutoModelForMaskedLM
|
32 |
import torch
|
|
|
13 |
|
14 |
The Nucleotide Transformers are a collection of foundational language models that were pre-trained on DNA sequences from whole-genomes. Compared to other approaches, our models do not only integrate information from single reference genomes, but leverage DNA sequences from over 3,200 diverse human genomes, as well as 850 genomes from a wide range of species, including model and non-model organisms. Through robust and extensive evaluation, we show that these large models provide extremely accurate molecular phenotype prediction compared to existing methods
|
15 |
|
16 |
+
Part of this collection is the **nucleotide-transformer-500m-human-ref**, a 500M parameters transformer pre-trained on the human reference genome. The model is made available both in Tensorflow and Pytorch.
|
17 |
|
18 |
**Developed by:** InstaDeep, NVIDIA and TUM
|
19 |
|
|
|
27 |
### How to use
|
28 |
|
29 |
<!-- Need to adapt this section to our model. Need to figure out how to load the models from huggingface and do inference on them -->
|
30 |
+
Until its next release, the `transformers` library needs to be installed from source with the following command in order to use the models:
|
31 |
+
```bash
|
32 |
+
pip install --upgrade git+https://github.com/huggingface/transformers.git
|
33 |
+
```
|
34 |
+
|
35 |
+
A small snippet of code is given here in order to retrieve both logits and embeddings from a dummy DNA sequence.
|
36 |
```python
|
37 |
from transformers import AutoTokenizer, AutoModelForMaskedLM
|
38 |
import torch
|