Spaces:

matthoffner
/

ggml-mllm

Paused

App Files Files Community

ggml-mllm / main.py

matthoffner's picture

Create main.py

f0788cb almost 2 years ago

226 Bytes

	from llama_cpp.server.app import create_app, Settings


	import tomllib


	import tomllib

	with open("config.toml", "rb") as f:
	settings = tomllib.load(f)

	settings = Settings(**settings)

	app = create_app(settings=settings)