DGurgurov/xlm-r_welsh_sentiment

Fine-tuned XLM-R Model for welsh Sentiment Analysis

This is a fine-tuned XLM-R model for sentiment analysis in welsh.

Model Details

• Model Name: XLM-R Sentiment Analysis
• Language: welsh
• Fine-tuning Dataset: DGurgurov/welsh_sa

Training Details

• Epochs: 20
• Batch Size: 32 (train), 64 (eval)
• Optimizer: AdamW
• Learning Rate: 5e-5

Performance Metrics

• Accuracy: 0.86613
• Macro F1: 0.86609
• Micro F1: 0.86613

Usage

To use this model, you can load it with the Hugging Face Transformers library:

from transformers import AutoTokenizer, AutoModelForSequenceClassification

tokenizer = AutoTokenizer.from_pretrained("DGurgurov/xlm-r_welsh_sentiment")
model = AutoModelForSequenceClassification.from_pretrained("DGurgurov/xlm-r_welsh_sentiment")

License

[MIT]