ggml-mllm / config.toml
matthoffner's picture
Update config.toml
8d540d5
raw
history blame
74 Bytes
model="stablebeluga-7b.ggmlv3.q4_K_M.bin"
n_threads="4"
n_gpu_layers="100"