xlm-roberta-large-nubes

This model is a finetuned version of xlm-roberta-large for the nubes dataset used in a benchmark in the paper TODO. The model has a F1 of 0.92

Please refer to the original publication for more information TODO LINK

Parameters used

parameter	Value
batch size	32
learning rate	2e-05
classifier dropout	0.2
warmup ratio	0
warmup steps	0
weight decay	0
optimizer	AdamW
epochs	10
early stopping patience	3

BibTeX entry and citation info

TODO

Downloads last month: 29

Inference Examples

Token Classification

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including IIC/xlm-roberta-large-nubes

👨🏻‍⚕️ Spanish Clinical Encoders Analysis

Collection

Models and datasets used in the paper `A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks` • 92 items • Updated Jan 23 • 1

Evaluation results

f1 on nubes
test set self-reported

0.920

View on Papers With Code