set use_cache to true

by loubnabnl HF staff - opened May 16, 2023

←

Hugging Face H4 org May 16, 2023

as discussed in this thread this should make inference much faster

lewtun

Hugging Face H4 org May 22, 2023

Thanks for the fix!

lewtun changed pull request status to merged May 22, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment