metadata

title: README
emoji: 🏢
colorFrom: red
colorTo: yellow
sdk: static
pinned: false

BMI - Biomedical Informatics Lab "Mario Stefanelli"

About Us

BMI belongs to the Department of Electrical, Computer, and Biomedical Engineering (Faculty of Engineering) of the University of Pavia. Established in 1982, it is a leading center for education, research, and IT innovative solutions in the healthcare area. Nowadays about 30 people are working at BMI, focusing their research on:

Bioinformatics
Clinical Data Mining
Models of Biological Systems
Biomedical Knowledge Management
Decision Support Systems
Telemedicine
E-learning

NLP Models

Our research interests have led us to frequently explore the realm of Natural Language Processing, including Transformers. Here we host public weights for our biomedical language models. There are several options to choose from, please check the details below.

Model	Domain	Type	Details
MedBIT-R3+ (recommended)	Medical	MaskedLM Pretrain	Trained after BioBIT with additional 200MB of medical textbook data and web-crawled medical resources in Italian. Regularized with LLRD (.95), Mixout (.9), and Warmup (.02).
MedBIT	Medical	MaskedLM Pretrain	Trained after BioBIT with additional 100MB of medical textbook data without any regularization.

Other models coming soon!