Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Ihorย 
posted an update about 1 month ago
Post
682
๐Ÿš€ Meet the new GLiNER architecture ๐Ÿš€
GLiNER revolutionized zero-shot NER by demonstrating that lightweight encoders can achieve excellent results. We're excited to continue R&D with this spirit ๐Ÿ”ฅ. Our new bi-encoder and poly-encoder architectures were developed to address the main limitations of the original GLiNER architecture and bring the following new possibilities:

๐Ÿ”น An unlimited number of entities can be recognized at once.
๐Ÿ”นFaster inference when entity embeddings are preprocessed.
๐Ÿ”นBetter generalization to unseen entities.

While the bi-encoder architecture can lack inter-label understanding, we developed a poly-encoder architecture with post-fusion. It achieves the same or even better results on many benchmarking datasets compared to the original GLiNER, while still offering the listed advantages of bi-encoders.
Now, itโ€™s possible to run GLiNER with hundreds of entities much faster and more reliably.

๐Ÿ“Œ Try the new models here:
knowledgator/gliner-bi-encoders-66c492ce224a51c54232657b

Thanks for sharing this development! Can you also write a blog or paper to understand it better? Thanks

ยท

Yeah, we are working on it