Update README.md
Browse files
README.md
CHANGED
|
@@ -56,7 +56,7 @@ _ = model.embed_dataset(
|
|
| 56 |
)
|
| 57 |
```
|
| 58 |
## Model probes
|
| 59 |
-
We employ linear probing techniques on various PLMs and standard datasets, similar our previous [paper](https://www.biorxiv.org/content/10.1101/2024.07.30.605924v1), to
|
| 60 |
|
| 61 |
The plot below showcases performance normalized between the negative control (random vector embeddings) and the best performer. Classification task scores are averaged between MCC and F1 (or F1max for multilabel) and regression tasks are averaged between Spearman rho and R2.
|
| 62 |
|
|
|
|
| 56 |
)
|
| 57 |
```
|
| 58 |
## Model probes
|
| 59 |
+
We employ linear probing techniques on various PLMs and standard datasets, similar our previous [paper](https://www.biorxiv.org/content/10.1101/2024.07.30.605924v1), to assess the intrinsic correlation between pooled hidden states and valuable properties. FastESM performs very well.
|
| 60 |
|
| 61 |
The plot below showcases performance normalized between the negative control (random vector embeddings) and the best performer. Classification task scores are averaged between MCC and F1 (or F1max for multilabel) and regression tasks are averaged between Spearman rho and R2.
|
| 62 |
|