runtime error
Exit code: 1. Reason: tokenizer_config.json: 0%| | 0.00/7.30k [00:00<?, ?B/s][A tokenizer_config.json: 100%|██████████| 7.30k/7.30k [00:00<00:00, 39.0MB/s] vocab.json: 0%| | 0.00/2.78M [00:00<?, ?B/s][A vocab.json: 100%|██████████| 2.78M/2.78M [00:00<00:00, 31.1MB/s] merges.txt: 0%| | 0.00/1.67M [00:00<?, ?B/s][A merges.txt: 100%|██████████| 1.67M/1.67M [00:00<00:00, 30.3MB/s] tokenizer.json: 0%| | 0.00/7.03M [00:00<?, ?B/s][A tokenizer.json: 100%|██████████| 7.03M/7.03M [00:01<00:00, 4.75MB/s][A tokenizer.json: 100%|██████████| 7.03M/7.03M [00:01<00:00, 4.74MB/s] config.json: 0%| | 0.00/663 [00:00<?, ?B/s][A config.json: 100%|██████████| 663/663 [00:00<00:00, 3.66MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 12, in <module> model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype="auto", device_map="auto") File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 600, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 316, in _wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4784, in from_pretrained raise ValueError( ValueError: Using a `device_map`, `tp_plan`, `torch.device` context manager or setting `torch.set_default_device(device)` requires `accelerate`. You can install it with `pip install accelerate`
Container logs:
Fetching error logs...