Hugging Face's logo

Spaces:
matthoffner
/
ggml-mllm
Paused

App Files Community
matthoffner commited on
Commit
c33748c
·
1 Parent(s): 60b02b2

Update config.toml

Browse files
Files changed (1) hide show
  1. config.toml +2 -5
config.toml CHANGED
@@ -1,6 +1,3 @@
1
- model="robin-13b.ggmlv3.q3_K_M.bin"
2
- use_mmap="True"
3
- use_mlock="True"
4
- n_threads="8"
5
- n_ctx="2048"
6
  n_gpu_layers="20"
 
1
+ model="robin-13b.ggmlv3.q4_0.bin"
2
+ n_threads="6"
 
 
 
3
  n_gpu_layers="20"