ONNX reranker model
#9
by
doberst
- opened
Hi Jina AI team, congratulations on a great model. I have been doing a lot of testing with the Pytorch version and have been very impressed with both the quality, speed and overall model design (especially for in-memory use cases). In parallel, we will be doing some work with ONNX in a variety of environments and am interested to learn more about the ONNX compiled version - could you point me to any specific documentation on how to set up the inference inputs? Also, in your testing, have you seen decent results with ONNX in terms of speed and accuracy, especially on CPU environments? kind regards - Darren