runtime error
��█| 112/112 [00:00<00:00, 914kB/s] Downloading (…)lve/main/config.json: 0%| | 0.00/612 [00:00<?, ?B/s] Downloading (…)lve/main/config.json: 100%|██████████| 612/612 [00:00<00:00, 4.98MB/s] Downloading pytorch_model.bin: 0%| | 0.00/90.9M [00:00<?, ?B/s] Downloading pytorch_model.bin: 12%|█▏ | 10.5M/90.9M [00:00<00:01, 69.3MB/s] Downloading pytorch_model.bin: 35%|███▍ | 31.5M/90.9M [00:00<00:01, 57.1MB/s] Downloading pytorch_model.bin: 46%|████▌ | 41.9M/90.9M [00:00<00:00, 58.5MB/s] Downloading pytorch_model.bin: 58%|█████▊ | 52.4M/90.9M [00:00<00:00, 64.9MB/s] Downloading pytorch_model.bin: 69%|██████▉ | 62.9M/90.9M [00:00<00:00, 67.0MB/s] Downloading pytorch_model.bin: 81%|████████ | 73.4M/90.9M [00:01<00:00, 70.1MB/s] Downloading pytorch_model.bin: 92%|█████████▏| 83.9M/90.9M [00:01<00:00, 57.3MB/s] Downloading pytorch_model.bin: 100%|██████████| 90.9M/90.9M [00:01<00:00, 64.7MB/s] Downloading (…)lve/main/config.json: 0%| | 0.00/571 [00:00<?, ?B/s] Downloading (…)lve/main/config.json: 100%|██████████| 571/571 [00:00<00:00, 4.30MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 10, in <module> llm = LLM("mistralai/Mistral-7B-Instruct-v0.1") File "/home/user/app/models/llms.py", line 11, in __init__ self.model = AutoModelForCausalLM.from_pretrained( File "/home/user/.local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 565, in from_pretrained return model_class.from_pretrained( File "/home/user/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 2614, in from_pretrained raise ImportError( ImportError: Using `load_in_8bit=True` requires Accelerate: `pip install accelerate` and the latest version of bitsandbytes `pip install -i https://test.pypi.org/simple/ bitsandbytes` or pip install bitsandbytes`
Container logs:
Fetching error logs...