Hugging Face's logo
dnola
/
Runtime error

runtime error

Exit code: 1. Reason: src -I/tmp/pip-install-k0hext9_/flash-attn_a0d00fda179d4816990a4fd7b96e6eb7/csrc/cutlass/include -I/home/user/.pyenv/versions/3.10.16/lib/python3.10/site-packages/torch/include -I/home/user/.pyenv/versions/3.10.16/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/home/user/.pyenv/versions/3.10.16/lib/python3.10/site-packages/torch/include/TH -I/home/user/.pyenv/versions/3.10.16/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/.pyenv/versions/3.10.16/include/python3.10 -c csrc/flash_attn/src/flash_bwd_hdim128_bf16_causal_sm80.cu -o build/temp.linux-x86_64-cpython-310/csrc/flash_attn/src/flash_bwd_hdim128_bf16_causal_sm80.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -O3 -std=c++17 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math -Xfatbin -compress-all -compress-mode=size -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 --threads 4 -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_gcc\" -DPYBIND11_STDLIB=\"_libstdcpp\" -DPYBIND11_BUILD_ABI=\"_cxxabi1011\" -DTORCH_EXTENSION_NAME=flash_attn_2_cuda -D_GLIBCXX_USE_CXX11_ABI=0 nvcc fatal : Unknown option '-compress-mode=size' error: command '/usr/local/cuda/bin/nvcc' failed with exit code 1 [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for flash-attn Failed to build flash-attn [notice] A new release of pip is available: 25.0 -> 25.1.1 [notice] To update, run: pip install --upgrade pip ERROR: Failed to build installable wheels for some pyproject.toml based projects (flash-attn) Failed to install flash-attn: Command '['pip', 'install', 'flash-attn', '--no-build-isolation']' returned non-zero exit status 1.

Container logs:

Fetching error logs...