Spaces:

Mat17892
/

iris

Runtime error

App Files Files Community

iris / llama.cpp /examples /lookahead /README.md

Mat17892's picture

llamacpp

b664585 verified 4 months ago

|

history blame contribute delete

195 Bytes

A newer version of the Gradio SDK is available: 5.24.0

Upgrade

llama.cpp/examples/lookahead

Demonstration of lookahead decoding technique:

https://lmsys.org/blog/2023-11-21-lookahead-decoding/

More info: https://github.com/ggerganov/llama.cpp/pull/4207