akirus's picture
Update README.md
a8ccca6 verified
---
library_name: transformers
language:
- ru
- lez
license: apache-2.0
datasets:
- leks-forever/bible-lezghian-russian
base_model:
- intfloat/multilingual-e5-large
pipeline_tag: feature-extraction
---
# Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->
## Model Details
### Model Description
<!-- Provide a longer summary of what this model is. -->
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- **Developed by:** Leks Forever Team
- **Language(s) (NLP):** Lezghian, Russian
- **Finetuned from model:** [intfloat/multilingual-e5-large](https://huggingface.co/intfloat/multilingual-e5-large)
### Model Sources [optional]
<!-- Provide the basic links for the model. -->
- **Repository:** https://github.com/leks-forever/embed-tuning
## Evaluation
The evaluation was conducted on the val set of the [bible-lezghian-russian](https://huggingface.co/datasets/leks-forever/bible-lezghian-russian) dataset, consisting of 5% of the total 13,800 parallel sentences.
Results using `Sentence Transformers` [TranslationEvaluator](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#translationevaluator):
* src2trg_accuracy: 0.73
* trg2src_accuracy: 0.73
* mean_accuracy: 0.73
<!--
## More Information [optional]
[More Information Needed]
## Model Card Authors [optional]
[More Information Needed]
## Model Card Contact
[More Information Needed]
-->