Hugging Face's logo

Qwen
/
Qwen2-VL-7B-Instruct

Image-Text-to-Text
Transformers
Safetensors
English
qwen2_vl
multimodal
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
59

RuntimeError: cu_seqlens_q must have dtype int32

#59
by ginnyyk - opened
Discussion
ginnyyk

I've got a runtime error for inference.
generated_ids = model.generate(**inputs, max_new_tokens=128)

Can anyone help with it? Thank you.

carmcheng

pip install transformers==4.46.3

This worked for me

Sign up or log in to comment