Spaces:
Running
on
Zero
Running
on
Zero
Upload 2 files
Browse files- Modelfile +8 -0
- requirements.txt +4 -0
Modelfile
ADDED
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
FROM llava:7b-v1.6-mistral-q2_K
|
2 |
+
|
3 |
+
PARAMETER temperature 0.1
|
4 |
+
# sets the context window size to 4096, this controls how many tokens the LLM can use as context to generate the next token
|
5 |
+
PARAMETER num_ctx 4096
|
6 |
+
|
7 |
+
# sets a custom system message to specify the behavior of the chat assistant
|
8 |
+
# SYSTEM You are a home surveillance system. Answer with very short sentences.
|
requirements.txt
ADDED
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
1 |
+
torch
|
2 |
+
transformers
|
3 |
+
ollama
|
4 |
+
opencv-python
|