KeyError: 'transformer.h.26.input_layernorm.weight'

by Mabeck - opened May 13

May 13

This may be a vLLM specific issue, but I get the following error when trying to load.

  File "/zhome/55/8/206247/scandenv/lib/python3.10/site-packages/vllm/model_executor/models/falcon.py", line 421, in load_weights
    param = params_dict[name]
KeyError: 'transformer.h.26.input_layernorm.weight'

nilabhra

Technology Innovation Institute org May 13

Hi! We have not yet worked on the vLLM code. The main branch of transformers should be able to load the model.

nilabhra changed discussion status to closed May 14

ssmits

May 23

I've opened a request on Github to add the model.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment