--- library_name: transformers language: - ru - lez license: apache-2.0 datasets: - leks-forever/bible-lezghian-russian base_model: - intfloat/multilingual-e5-large pipeline_tag: feature-extraction --- # Model Card for Model ID ## Model Details ### Model Description This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated. - **Developed by:** Leks Forever Team - **Language(s) (NLP):** Lezghian, Russian - **Finetuned from model:** [intfloat/multilingual-e5-large](https://huggingface.co/intfloat/multilingual-e5-large) ### Model Sources [optional] - **Repository:** https://github.com/leks-forever/embed-tuning ## Evaluation The evaluation was conducted on the val set of the [bible-lezghian-russian](https://huggingface.co/datasets/leks-forever/bible-lezghian-russian) dataset, consisting of 5% of the total 13,800 parallel sentences. Results using `Sentence Transformers` [TranslationEvaluator](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#translationevaluator): * src2trg_accuracy: 0.73 * trg2src_accuracy: 0.73 * mean_accuracy: 0.73