Matryoshka Embedding

#24
by XingyanZhang - opened

Is there any plan to support Matryoshka Embedding? It's a technique that allows for the generation of embeddings that remain useful even when truncated to smaller sizes, thus enabling faster processing and reduced storage requirements without significant loss in performance. https://huggingface.co/blog/matryoshka

NVIDIA org

Hi, @XingyanZhang . Thanks a lot for the suggestion. While we do not support in this version of NV-Embed, we consider adding Matryoshka Representation Learning (MRL) to next release of NV-Embed.

Sign up or log in to comment