|
--- |
|
language: es |
|
tags: |
|
- biomedical |
|
- clinical |
|
- spanish |
|
- bert-base-spanish-wwm-cased |
|
license: cc-by-4.0 |
|
datasets: |
|
- "lcampillos/ctebmsp" |
|
metrics: |
|
- f1 |
|
|
|
model-index: |
|
- name: IIC/bert-base-spanish-wwm-cased-ctebmsp |
|
results: |
|
- task: |
|
type: token-classification |
|
dataset: |
|
name: CT-EBM-SP (Clinical Trials for Evidence-based Medicine in Spanish) |
|
type: lcampillos/ctebmsp |
|
split: test |
|
metrics: |
|
- name: f1 |
|
type: f1 |
|
value: 0.88 |
|
pipeline_tag: token-classification |
|
|
|
--- |
|
|
|
# bert-base-spanish-wwm-cased-ctebmsp |
|
|
|
This model is a finetuned version of bert-base-spanish-wwm-cased for the CT-EBM-SP (Clinical Trials for Evidence-based Medicine in Spanish) dataset used in a benchmark in the paper `A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks`. The model has a F1 of 0.88 |
|
|
|
Please refer to the [original publication](https://doi.org/10.1093/jamia/ocae054) for more information. |
|
|
|
## Parameters used |
|
|
|
| parameter | Value | |
|
|-------------------------|:-----:| |
|
| batch size | 16 | |
|
| learning rate | 4e-05 | |
|
| classifier dropout | 0 | |
|
| warmup ratio | 0 | |
|
| warmup steps | 0 | |
|
| weight decay | 0 | |
|
| optimizer | AdamW | |
|
| epochs | 10 | |
|
| early stopping patience | 3 | |
|
|
|
|
|
## BibTeX entry and citation info |
|
|
|
```bibtext |
|
@article{10.1093/jamia/ocae054, |
|
author = {García Subies, Guillem and Barbero Jiménez, Álvaro and Martínez Fernández, Paloma}, |
|
title = {A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks}, |
|
journal = {Journal of the American Medical Informatics Association}, |
|
volume = {31}, |
|
number = {9}, |
|
pages = {2137-2146}, |
|
year = {2024}, |
|
month = {03}, |
|
issn = {1527-974X}, |
|
doi = {10.1093/jamia/ocae054}, |
|
url = {https://doi.org/10.1093/jamia/ocae054}, |
|
} |
|
``` |
|
|
|
|