Kazel commited on
Commit
5faca27
·
verified ·
1 Parent(s): df97b0c

Upload 2 files

Browse files
Files changed (2) hide show
  1. Modelfile +8 -0
  2. requirements.txt +4 -0
Modelfile ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ FROM llava:7b-v1.6-mistral-q2_K
2
+
3
+ PARAMETER temperature 0.1
4
+ # sets the context window size to 4096, this controls how many tokens the LLM can use as context to generate the next token
5
+ PARAMETER num_ctx 4096
6
+
7
+ # sets a custom system message to specify the behavior of the chat assistant
8
+ # SYSTEM You are a home surveillance system. Answer with very short sentences.
requirements.txt ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ torch
2
+ transformers
3
+ ollama
4
+ opencv-python