runtime error

Exit code: 1. Reason: from nvidia-cusolver-cu12==11.4.5.107->torch->flash-attn) (12.6.85) Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/site-packages (from jinja2->torch->flash-attn) (2.1.5) Requirement already satisfied: mpmath<1.4,>=1.1.0 in /usr/local/lib/python3.10/site-packages (from sympy->torch->flash-attn) (1.3.0) Downloading einops-0.8.1-py3-none-any.whl (64 kB) Building wheels for collected packages: flash-attn Building wheel for flash-attn (setup.py): started Building wheel for flash-attn (setup.py): finished with status 'done' Created wheel for flash-attn: filename=flash_attn-2.8.2-py3-none-any.whl size=286334 sha256=fbbbe677096d97e4e19074d75e86d093f2990e69c9e610ed7a8cc7ee2bdb2d9d Stored in directory: /home/user/.cache/pip/wheels/ae/2e/e8/9e6fe4527684a326f08d81f12715d78df48f568cb052190033 Successfully built flash-attn Installing collected packages: einops, flash-attn Successfully installed einops-0.8.1 flash-attn-2.8.2 [notice] A new release of pip is available: 24.3.1 -> 25.2 [notice] To update, run: /usr/local/bin/python -m pip install --upgrade pip The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling `transformers.utils.move_cache()`. 0it [00:00, ?it/s] 0it [00:00, ?it/s] Traceback (most recent call last): File "/home/user/app/app.py", line 36, in <module> import models File "/home/user/app/models/__init__.py", line 1, in <module> from .model import NextDiT_2B_patch2 File "/home/user/app/models/model.py", line 15, in <module> from flash_attn import flash_attn_varlen_func File "/usr/local/lib/python3.10/site-packages/flash_attn/__init__.py", line 3, in <module> from flash_attn.flash_attn_interface import ( File "/usr/local/lib/python3.10/site-packages/flash_attn/flash_attn_interface.py", line 15, in <module> import flash_attn_2_cuda as flash_attn_gpu ModuleNotFoundError: No module named 'flash_attn_2_cuda'

Container logs: