Detsutut commited on
Commit
8a9f7e1
·
1 Parent(s): 4e2ecc7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -11,7 +11,7 @@ pinned: false
11
 
12
  ## About Us
13
 
14
- BMI belongs to the Department of Electrical, Computer, and Biomedical Engineering (Faculty of Engineering) of the University of Pavia.
15
  Established in 1982, it is a leading center for education, research, and IT innovative solutions in the healthcare area. Nowadays about 30 people are working at BMI, focusing their research on:
16
 
17
  * Bioinformatics
@@ -29,7 +29,7 @@ Here we host public weights for our biomedical language models. There are severa
29
 
30
  | Model | Domain | Type | Details |
31
  |------------|---------|-------------------|-------------------------------------------------------------|
32
- | [MedBIT-R3+](https://huggingface.co/bmi-labmedinfo/medBIT-r3-plus) (recommended)| Medical | MaskedLM Pretrain | Trained after BioBIT with additional 200MB of medical textbook data and web-crawled medical resources in Italian. Regularized with LLRD (.95), Mixout (.9), and Warmup (.02). |
33
- | [MedBIT](https://huggingface.co/bmi-labmedinfo/medBIT) | Medical | MaskedLM Pretrain | Trained after BioBIT with additional 100MB of medical textbook data without any regularization. |
34
 
35
  Other models coming soon!
 
11
 
12
  ## About Us
13
 
14
+ BMI belongs to the Department of Electrical, Computer, and Biomedical Engineering (Faculty of Engineering) of the University of Pavia, Italy.
15
  Established in 1982, it is a leading center for education, research, and IT innovative solutions in the healthcare area. Nowadays about 30 people are working at BMI, focusing their research on:
16
 
17
  * Bioinformatics
 
29
 
30
  | Model | Domain | Type | Details |
31
  |------------|---------|-------------------|-------------------------------------------------------------|
32
+ | [MedBIT-R3+](https://huggingface.co/bmi-labmedinfo/medBIT-r3-plus) (recommended)| Medical | MaskedLM Pretrain | Trained after [BioBIT](https://huggingface.co/bmi-labmedinfo/bioBIT) with additional 200MB of medical textbook data and web-crawled medical resources in Italian. Regularized with LLRD (.95), Mixout (.9), and Warmup (.02). |
33
+ | [MedBIT](https://huggingface.co/bmi-labmedinfo/medBIT) | Medical | MaskedLM Pretrain | Trained after [BioBIT](https://huggingface.co/bmi-labmedinfo/bioBIT) with additional 100MB of medical textbook data without any regularization. |
34
 
35
  Other models coming soon!