Steven10429's picture
llama.cpp
61b850a
|
raw
history blame
112 Bytes

This is a swift clone of examples/batched.

$ make $ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]