RaphaelMourad
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -5,6 +5,7 @@ tags:
|
|
5 |
- mistral
|
6 |
- DNA
|
7 |
- bacteriophage
|
|
|
8 |
- biology
|
9 |
- genomics
|
10 |
---
|
@@ -13,7 +14,7 @@ tags:
|
|
13 |
|
14 |
The Mistral-DNA-v1-138M-bacteriophage Large Language Model (LLM) is a pretrained generative DNA text model with 17.31M parameters x 8 experts = 138.5M parameters.
|
15 |
It is derived from Mistral-7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
|
16 |
-
The model was pretrained using 30405
|
17 |
|
18 |
We used "RefSeq Phage FASTA File" database from https://phagescope.deepomics.org/download.
|
19 |
|
|
|
5 |
- mistral
|
6 |
- DNA
|
7 |
- bacteriophage
|
8 |
+
- phage
|
9 |
- biology
|
10 |
- genomics
|
11 |
---
|
|
|
14 |
|
15 |
The Mistral-DNA-v1-138M-bacteriophage Large Language Model (LLM) is a pretrained generative DNA text model with 17.31M parameters x 8 experts = 138.5M parameters.
|
16 |
It is derived from Mistral-7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
|
17 |
+
The model was pretrained using 30405 bacteriophage genomes > 10kb.
|
18 |
|
19 |
We used "RefSeq Phage FASTA File" database from https://phagescope.deepomics.org/download.
|
20 |
|