Detsutut commited on
Commit
4e2ecc7
·
1 Parent(s): 3a4bf94

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -1
README.md CHANGED
@@ -7,4 +7,29 @@ sdk: static
7
  pinned: false
8
  ---
9
 
10
- Edit this `README.md` markdown file to author your organization card 🔥
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  pinned: false
8
  ---
9
 
10
+ # BMI - Biomedical Informatics Lab "Mario Stefanelli"
11
+
12
+ ## About Us
13
+
14
+ BMI belongs to the Department of Electrical, Computer, and Biomedical Engineering (Faculty of Engineering) of the University of Pavia.
15
+ Established in 1982, it is a leading center for education, research, and IT innovative solutions in the healthcare area. Nowadays about 30 people are working at BMI, focusing their research on:
16
+
17
+ * Bioinformatics
18
+ * Clinical Data Mining
19
+ * Models of Biological Systems
20
+ * Biomedical Knowledge Management
21
+ * Decision Support Systems
22
+ * Telemedicine
23
+ * E-learning
24
+
25
+ ## NLP Models
26
+
27
+ Our research interests have led us to frequently explore the realm of Natural Language Processing, including Transformers.
28
+ Here we host public weights for our biomedical language models. There are several options to choose from, please check the details below.
29
+
30
+ | Model | Domain | Type | Details |
31
+ |------------|---------|-------------------|-------------------------------------------------------------|
32
+ | [MedBIT-R3+](https://huggingface.co/bmi-labmedinfo/medBIT-r3-plus) (recommended)| Medical | MaskedLM Pretrain | Trained after BioBIT with additional 200MB of medical textbook data and web-crawled medical resources in Italian. Regularized with LLRD (.95), Mixout (.9), and Warmup (.02). |
33
+ | [MedBIT](https://huggingface.co/bmi-labmedinfo/medBIT) | Medical | MaskedLM Pretrain | Trained after BioBIT with additional 100MB of medical textbook data without any regularization. |
34
+
35
+ Other models coming soon!