Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -29,7 +29,14 @@ Here we host public weights for our biomedical language models. There are severa
|
|
| 29 |
|
| 30 |
| Model | Domain | Type | Details |
|
| 31 |
|------------|---------|-------------------|-------------------------------------------------------------|
|
| 32 |
-
| [MedBIT-R3+](https://huggingface.co/bmi-labmedinfo/medBIT-r3-plus) (recommended)
|
| 33 |
-
| [MedBIT](https://huggingface.co/bmi-labmedinfo/medBIT)
|
| 34 |
|
| 35 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
|
| 30 |
| Model | Domain | Type | Details |
|
| 31 |
|------------|---------|-------------------|-------------------------------------------------------------|
|
| 32 |
+
| [MedBIT-R3+](https://huggingface.co/bmi-labmedinfo/medBIT-r3-plus) (recommended) <sup>⸸</sup>| Medical | MaskedLM Pretrain | Trained after [BioBIT](https://huggingface.co/bmi-labmedinfo/bioBIT) with additional 200MB of medical textbook data and web-crawled medical resources in Italian. Regularized with LLRD (.95), Mixout (.9), and Warmup (.02). |
|
| 33 |
+
| [MedBIT](https://huggingface.co/bmi-labmedinfo/medBIT) <sup>⸸</sup>| Medical | MaskedLM Pretrain | Trained after [BioBIT](https://huggingface.co/bmi-labmedinfo/bioBIT) with additional 100MB of medical textbook data without any regularization. |
|
| 34 |
|
| 35 |
+
<sup>⸸</sup> <small>model developed in partnership with the [Neuroinformatics Lab](https://www.fatebenefratelli.it/it/ricerca_irccs-brescia#tab-15) of IRCCS Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy</small>
|
| 36 |
+
|
| 37 |
+
|
| 38 |
+
Other models coming soon!
|
| 39 |
+
|
| 40 |
+
## Related Research Papers
|
| 41 |
+
|
| 42 |
+
* *Buonocore, T. M., Parimbelli, E., Sacchi, L., Bellazzi, R., Del Campo, L., & Quaglini, S. (2022). Improving Keyword-Based Topic Classification in Cancer Patient Forums with Multilingual Transformers. Studies in health technology and informatics, 290, 597–601. https://doi.org/10.3233/SHTI220147*
|