runtime error
Exit code: 1. Reason: 0:00<?, ?it/s][A Loading checkpoint shards: 20%|██ | 1/5 [00:04<00:16, 4.25s/it][A Loading checkpoint shards: 40%|████ | 2/5 [00:09<00:14, 4.83s/it][A Loading checkpoint shards: 60%|██████ | 3/5 [00:14<00:09, 4.84s/it][A Loading checkpoint shards: 80%|████████ | 4/5 [00:19<00:05, 5.15s/it][A Loading checkpoint shards: 100%|██████████| 5/5 [00:21<00:00, 3.84s/it][A Loading checkpoint shards: 100%|██████████| 5/5 [00:21<00:00, 4.30s/it] Traceback (most recent call last): File "/home/user/app/app.py", line 3, in <module> from chatbot import model_inference, EXAMPLES, chatbot File "/home/user/app/chatbot.py", line 30, in <module> model = Qwen2VLForConditionalGeneration.from_pretrained(MODEL_ID, trust_remote_code=True, torch_dtype=torch.float16).to("cuda").eval() File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3125, in to return super().to(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1340, in to return self._apply(convert) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 900, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 900, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 900, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 927, in _apply param_applied = fn(param) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1326, in convert return t.to( File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 319, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
Container logs:
Fetching error logs...