How would I offload layers such that I can run this model on 8GB VRAM?

#18
by txhno - opened

Any flags or arguments to use?

Sign up or log in to comment