runtime error

Exit code: 1. Reason: 411MB/s] model-00002-of-00002.safetensors: 0%| | 0.00/564M [00:00<?, ?B/s] model.safetensors: 100%|██████████| 1.74G/1.74G [00:13<00:00, 130MB/s] model-00002-of-00002.safetensors: 17%|█▋ | 94.5M/564M [00:01<00:06, 72.4MB/s] model-00002-of-00002.safetensors: 100%|██████████| 564M/564M [00:02<00:00, 254MB/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 50%|█████ | 1/2 [00:04<00:04, 4.00s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:04<00:00, 2.18s/it] generation_config.json: 0%| | 0.00/124 [00:00<?, ?B/s] generation_config.json: 100%|██████████| 124/124 [00:00<00:00, 776kB/s] Traceback (most recent call last): File "/app/app.py", line 8, in <module> policy_model, gen_model, tokenizer = load_policy_model() File "/app/policy.py", line 15, in load_policy_model policy_model.to("cuda") File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4343, in to return super().to(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1371, in to return self._apply(convert) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 930, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 930, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 957, in _apply param_applied = fn(param) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1357, in convert return t.to( File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 410, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx

Container logs:

Fetching error logs...