XLM_R_Galen-nubes

This model is a finetuned version of XLM_R_Galen for the nubes dataset used in a benchmark in the paper TODO. The model has a F1 of 0.908

Please refer to the original publication for more information TODO LINK

Parameters used

parameter	Value
batch size	16
learning rate	3e-05
classifier dropout	0.2
warmup ratio	0
warmup steps	0
weight decay	0
optimizer	AdamW
epochs	10
early stopping patience	3

BibTeX entry and citation info

TODO

Downloads last month: 2

Safetensors

Model size

278M params

Tensor type

I64

F32

Inference Providers NEW

Token Classification

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Collection including IIC/XLM_R_Galen-nubes

👨🏻‍⚕️ Spanish Clinical Encoders Analysis

Collection

Models and datasets used in the paper `A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks` • 92 items • Updated Jan 23, 2024 • 1

Evaluation results

f1 on nubes
test set self-reported

0.908

View on Papers With Code