Spaces:

ysharma
/

Explore_llamav2_with_TGI

Runtime error

Amazing inference speed

#77

by hexing1994 - opened Jul 28, 2023

Jul 28, 2023

The inference speed is amazing for the Llama 2 70B model! Could you please share the spec of the server you are using? Are you running on GPU?

hexing1994 changed discussion status to closed Jul 31, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment