ValueError: not enough values to unpack
#6
by
FareedKhan
- opened
ValueError Traceback (most recent call last)
in <cell line: 6>()
4 '''
5
----> 6 print(pipe(prompt_template)[0]['generated_text'])
16 frames
/usr/local/lib/python3.10/dist-packages/auto_gptq/nn_modules/fused_llama_attn.py in forward(self, hidden_states, past_key_value, attention_mask, position_ids, output_attentions, use_cache, **kwargs)
52
53 qkv_states = self.qkv_proj(hidden_states)
---> 54 query_states, key_states, value_states = torch.split(qkv_states, self.hidden_size, dim=2)
55
56 query_states = query_states.view(bsz, q_len, self.num_heads, self.head_dim).transpose(1, 2)
ValueError: not enough values to unpack (expected 3, got 2)