Spaces:
Running
Running
| title: README | |
| emoji: 🏢 | |
| colorFrom: red | |
| colorTo: yellow | |
| sdk: static | |
| pinned: false | |
| # BMI - Biomedical Informatics Lab "Mario Stefanelli" | |
| ## About Us | |
| BMI belongs to the Department of Electrical, Computer, and Biomedical Engineering (Faculty of Engineering) of the University of Pavia. | |
| Established in 1982, it is a leading center for education, research, and IT innovative solutions in the healthcare area. Nowadays about 30 people are working at BMI, focusing their research on: | |
| * Bioinformatics | |
| * Clinical Data Mining | |
| * Models of Biological Systems | |
| * Biomedical Knowledge Management | |
| * Decision Support Systems | |
| * Telemedicine | |
| * E-learning | |
| ## NLP Models | |
| Our research interests have led us to frequently explore the realm of Natural Language Processing, including Transformers. | |
| Here we host public weights for our biomedical language models. There are several options to choose from, please check the details below. | |
| | Model | Domain | Type | Details | | |
| |------------|---------|-------------------|-------------------------------------------------------------| | |
| | [MedBIT-R3+](https://huggingface.co/bmi-labmedinfo/medBIT-r3-plus) (recommended)| Medical | MaskedLM Pretrain | Trained after BioBIT with additional 200MB of medical textbook data and web-crawled medical resources in Italian. Regularized with LLRD (.95), Mixout (.9), and Warmup (.02). | | |
| | [MedBIT](https://huggingface.co/bmi-labmedinfo/medBIT) | Medical | MaskedLM Pretrain | Trained after BioBIT with additional 100MB of medical textbook data without any regularization. | | |
| Other models coming soon! |