Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
@@ -11,7 +11,7 @@ pinned: false
|
|
11 |
|
12 |
## About Us
|
13 |
|
14 |
-
BMI belongs to the Department of Electrical, Computer, and Biomedical Engineering (Faculty of Engineering) of the University of Pavia.
|
15 |
Established in 1982, it is a leading center for education, research, and IT innovative solutions in the healthcare area. Nowadays about 30 people are working at BMI, focusing their research on:
|
16 |
|
17 |
* Bioinformatics
|
@@ -29,7 +29,7 @@ Here we host public weights for our biomedical language models. There are severa
|
|
29 |
|
30 |
| Model | Domain | Type | Details |
|
31 |
|------------|---------|-------------------|-------------------------------------------------------------|
|
32 |
-
| [MedBIT-R3+](https://huggingface.co/bmi-labmedinfo/medBIT-r3-plus) (recommended)| Medical | MaskedLM Pretrain | Trained after BioBIT with additional 200MB of medical textbook data and web-crawled medical resources in Italian. Regularized with LLRD (.95), Mixout (.9), and Warmup (.02). |
|
33 |
-
| [MedBIT](https://huggingface.co/bmi-labmedinfo/medBIT) | Medical | MaskedLM Pretrain | Trained after BioBIT with additional 100MB of medical textbook data without any regularization. |
|
34 |
|
35 |
Other models coming soon!
|
|
|
11 |
|
12 |
## About Us
|
13 |
|
14 |
+
BMI belongs to the Department of Electrical, Computer, and Biomedical Engineering (Faculty of Engineering) of the University of Pavia, Italy.
|
15 |
Established in 1982, it is a leading center for education, research, and IT innovative solutions in the healthcare area. Nowadays about 30 people are working at BMI, focusing their research on:
|
16 |
|
17 |
* Bioinformatics
|
|
|
29 |
|
30 |
| Model | Domain | Type | Details |
|
31 |
|------------|---------|-------------------|-------------------------------------------------------------|
|
32 |
+
| [MedBIT-R3+](https://huggingface.co/bmi-labmedinfo/medBIT-r3-plus) (recommended)| Medical | MaskedLM Pretrain | Trained after [BioBIT](https://huggingface.co/bmi-labmedinfo/bioBIT) with additional 200MB of medical textbook data and web-crawled medical resources in Italian. Regularized with LLRD (.95), Mixout (.9), and Warmup (.02). |
|
33 |
+
| [MedBIT](https://huggingface.co/bmi-labmedinfo/medBIT) | Medical | MaskedLM Pretrain | Trained after [BioBIT](https://huggingface.co/bmi-labmedinfo/bioBIT) with additional 100MB of medical textbook data without any regularization. |
|
34 |
|
35 |
Other models coming soon!
|