Hugging Face's logo

Spaces:
terryli
/
llm-app
Runtime error

App Files Community
terry-li-hm commited on
Commit
4c0f2ec
·
1 Parent(s): 7bb49ef

`torch` only

Browse files
Files changed (2) hide show
  1. Dockerfile +2 -1
  2. requirements.txt +6 -6
Dockerfile CHANGED
@@ -1,4 +1,5 @@
1
- FROM python:3.9
 
2
  # RUN sudo apt-get remove --purge '^nvidia-.*'
3
  # RUN sudo apt-get remove --purge '^libnvidia-.*'
4
  # RUN sudo apt-get autoremove
 
1
+ FROM nvidia/cuda:12.0.0-cudnn8-devel-ubuntu22.04
2
+ # FROM python:3.9
3
  # RUN sudo apt-get remove --purge '^nvidia-.*'
4
  # RUN sudo apt-get remove --purge '^libnvidia-.*'
5
  # RUN sudo apt-get autoremove
requirements.txt CHANGED
@@ -1,12 +1,12 @@
1
  --extra-index-url https://download.pytorch.org/whl/cu113
2
- chainlit
3
- llama-index
4
- trafilatura
5
- openai
6
  torch
7
  # transformers
8
  # accelerate
9
  # scipy
10
  # bitsandbytes
11
- litellm
12
- vllm
 
1
  --extra-index-url https://download.pytorch.org/whl/cu113
2
+ # chainlit
3
+ # llama-index
4
+ # trafilatura
5
+ # openai
6
  torch
7
  # transformers
8
  # accelerate
9
  # scipy
10
  # bitsandbytes
11
+ # litellm
12
+ # vllm