Spaces:

matthoffner
/

ggml-mllm

Paused

ggml-mllm / config.toml

Update config.toml

a1ddfcc almost 2 years ago

155 Bytes

	model="airoboros-33B-gpt4-1.2-GGML/airoboros-33b-gpt4-1.2.ggmlv3.q3_K_M.bin"
	use_mmap="True"
	use_mlock="True"
	n_threads="10"
	n_ctx="2048"
	n_gpu_layers="35"