slide_window报错
#2
by
weiminw
- opened
在config.json里面把slide_window 设置为true，使用Vllm 0.4.3 启动，报错：
ValueError: Sliding window for some but all layers is not supported. This model uses sliding window but max_window_layers = 35 is less than num_hidden_layers = 64. Please open an issue to discuss this feature.