Spaces:

Steven10429
/

apply_lora_and_quantize

Running

App Files Files Community

apply_lora_and_quantize / llama.cpp /examples /batched.swift /README.md

Steven10429's picture

llama.cpp

61b850a about 2 months ago

|

history blame contribute delete

112 Bytes

A newer version of the Gradio SDK is available: 5.23.1

Upgrade

This is a swift clone of examples/batched.

$ make $ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]