Error when loading model KeyError: 'qwen2'

#11

by longluu - opened Jul 23

Jul 23

Hi, thanks for publishing this model and its performance is quite impressive. When I tried to load the model using sentence-transformers, it returns this error "KeyError: 'qwen2'". Do you have any insights on that? Thanks.

tomaarsen

Jul 23

Hello!
I'm not 100% sure what's causing this, but I have two ideas:

Make sure to add trust_remote_code=True when loading the model via Sentence Transformers (see also the usage snippet).
Consider upgrading the transformers version, e.g. pip install -U transformers (and then perhaps also sentence-transformers if it introduces new issues)

Tom Aarsen

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment