runtime error
Exit code: 1. Reason: G [00:03<00:00, 540MB/s][A model-00005-of-00005.safetensors: 100%|█████████▉| 1.47G/1.47G [00:03<00:00, 446MB/s] Loading checkpoint shards: 0%| | 0/5 [00:00<?, ?it/s][A Loading checkpoint shards: 40%|████ | 2/5 [00:05<00:08, 2.71s/it][A Loading checkpoint shards: 60%|██████ | 3/5 [00:12<00:08, 4.39s/it][A Loading checkpoint shards: 80%|████████ | 4/5 [00:19<00:05, 5.66s/it][A Loading checkpoint shards: 100%|██████████| 5/5 [00:25<00:00, 5.70s/it][A Loading checkpoint shards: 100%|██████████| 5/5 [00:25<00:00, 5.15s/it] generation_config.json: 0%| | 0.00/215 [00:00<?, ?B/s][A generation_config.json: 100%|██████████| 215/215 [00:00<00:00, 1.90MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 20, in <module> model = MllamaForConditionalGeneration.from_pretrained(ckpt, torch_dtype=torch.bfloat16).to("cuda") File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3712, in to return super().to(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1174, in to return self._apply(convert) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 780, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 780, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 805, in _apply param_applied = fn(param) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1160, in convert return t.to( File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 314, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
Container logs:
Fetching error logs...