xinference / requirements.txt
zhengr's picture
Update requirements.txt
d8949c4 verified
raw
history blame
650 Bytes
xoscar>=0.3.0
gradio==4.26.0
typer[all]<0.12.0
pillow
click
tqdm>=4.27
tabulate
requests
pydantic
fastapi==0.110.3
uvicorn
huggingface-hub>=0.19.4
typing_extensions
fsspec==2023.10.0
s3fs==2023.10.0
boto3>=1.28.55,<1.28.65
tensorizer~=2.9.0
modelscope>=1.10.0
sse_starlette>=1.6.5
openai>1
python-jose[cryptography]
passlib[bcrypt]
aioprometheus[starlette]>=23.12.0
pynvml
async-timeout
transformers==4.41.2
accelerate>=0.20.3
sentencepiece
transformers_stream_generator
bitsandbytes
protobuf
einops
tiktoken
sentence-transformers>=2.3.1
FlagEmbedding
diffusers
controlnet_aux
orjson
auto-gptq
autoawq
optimum
peft
timm
opencv-contrib-python-headless