Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
@@ -7,4 +7,29 @@ sdk: static
|
|
7 |
pinned: false
|
8 |
---
|
9 |
|
10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
7 |
pinned: false
|
8 |
---
|
9 |
|
10 |
+
# BMI - Biomedical Informatics Lab "Mario Stefanelli"
|
11 |
+
|
12 |
+
## About Us
|
13 |
+
|
14 |
+
BMI belongs to the Department of Electrical, Computer, and Biomedical Engineering (Faculty of Engineering) of the University of Pavia.
|
15 |
+
Established in 1982, it is a leading center for education, research, and IT innovative solutions in the healthcare area. Nowadays about 30 people are working at BMI, focusing their research on:
|
16 |
+
|
17 |
+
* Bioinformatics
|
18 |
+
* Clinical Data Mining
|
19 |
+
* Models of Biological Systems
|
20 |
+
* Biomedical Knowledge Management
|
21 |
+
* Decision Support Systems
|
22 |
+
* Telemedicine
|
23 |
+
* E-learning
|
24 |
+
|
25 |
+
## NLP Models
|
26 |
+
|
27 |
+
Our research interests have led us to frequently explore the realm of Natural Language Processing, including Transformers.
|
28 |
+
Here we host public weights for our biomedical language models. There are several options to choose from, please check the details below.
|
29 |
+
|
30 |
+
| Model | Domain | Type | Details |
|
31 |
+
|------------|---------|-------------------|-------------------------------------------------------------|
|
32 |
+
| [MedBIT-R3+](https://huggingface.co/bmi-labmedinfo/medBIT-r3-plus) (recommended)| Medical | MaskedLM Pretrain | Trained after BioBIT with additional 200MB of medical textbook data and web-crawled medical resources in Italian. Regularized with LLRD (.95), Mixout (.9), and Warmup (.02). |
|
33 |
+
| [MedBIT](https://huggingface.co/bmi-labmedinfo/medBIT) | Medical | MaskedLM Pretrain | Trained after BioBIT with additional 100MB of medical textbook data without any regularization. |
|
34 |
+
|
35 |
+
Other models coming soon!
|