Hugging Face's logo

Spaces:
matthoffner
/
ggml-mllm
Paused

App Files Community
matthoffner commited on
Commit
217f5be
·
1 Parent(s): 78875c4

Update config.toml

Browse files
Files changed (1) hide show
  1. config.toml +3 -2
config.toml CHANGED
@@ -1,6 +1,7 @@
1
- model="guanaco-33B-GGML/guanaco-33B.ggmlv3.q4_0.bin"
2
  use_mmap="True"
3
  use_mlock="True"
4
  n_threads="6"
5
  n_ctx="2048"
6
- n_gpu_layers="50"
 
 
1
+ model="samantha-13B-GGML/samantha-13b.ggmlv3.q4_0.bin"
2
  use_mmap="True"
3
  use_mlock="True"
4
  n_threads="6"
5
  n_ctx="2048"
6
+ n_gpu_layers="50"
7
+ ngl="60"