Spaces:

winstxnhdw
/

llm-api

Running

llm-api / Dockerfile

fix: remove `caddy` to avoid violating HF ToS

8373866 about 1 year ago

170 Bytes

	FROM ghcr.io/winstxnhdw/llm-api:main

	ENV SERVER_PORT=7860
	ENV OMP_NUM_THREADS=2
	ENV CT2_USE_EXPERIMENTAL_PACKED_GEMM=1
	ENV CT2_FORCE_CPU_ISA=AVX512

	EXPOSE $SERVER_PORT