Can we train cross encoder using this model?
#4
by
amkorba
- opened
I have a bi encoder trained on bge-large-en which is pretrained and finetuned on domain data.
I want to have a cross encoder to enhance ranking , can i use Sentence_Transfomer cross encoder to train this ?
Bi-encoder and cross-encoder are very different. It may not be a good choice to train cross-encoder using bge. I prefer to use other pre-trained models, such as electra, deberta.
But you can use this bi-encoder to generate candidates which can be used to train cross-encoder.