runtime error

Exit code: 1. Reason: , user=None, eoh=None, assistant=None, eoa=None, separator=None, capability=None, stop_words=None) 2024-11-28 04:31:04,271 - lmdeploy - INFO - turbomind.py:301 - model_source: hf_model Traceback (most recent call last): File "/home/user/app/app.py", line 12, in <module> InterFace.async_engine = AsyncEngine( File "/usr/local/lib/python3.10/site-packages/lmdeploy/serve/async_engine.py", line 158, in __init__ self._build_turbomind(model_path=model_path, File "/usr/local/lib/python3.10/site-packages/lmdeploy/serve/async_engine.py", line 197, in _build_turbomind self.engine = tm.TurboMind.from_pretrained( File "/usr/local/lib/python3.10/site-packages/lmdeploy/turbomind/turbomind.py", line 302, in from_pretrained return cls(model_path=pretrained_model_name_or_path, File "/usr/local/lib/python3.10/site-packages/lmdeploy/turbomind/turbomind.py", line 112, in __init__ self.model_comm = self._from_hf(model_source=model_source, File "/usr/local/lib/python3.10/site-packages/lmdeploy/turbomind/turbomind.py", line 214, in _from_hf tm_model = get_tm_model(model_path, self.model_name, File "/usr/local/lib/python3.10/site-packages/lmdeploy/turbomind/deploy/converter.py", line 262, in get_tm_model get_output_model_registered_name_and_config( File "/usr/local/lib/python3.10/site-packages/lmdeploy/turbomind/deploy/converter.py", line 139, in get_output_model_registered_name_and_config if weight_type == 'bfloat16' and not is_bf16_supported(): File "/usr/local/lib/python3.10/site-packages/lmdeploy/utils.py", line 366, in is_bf16_supported device = torch.cuda.current_device() File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 878, in current_device _lazy_init() File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 314, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx

Container logs: