Memory requirements to load the model

#61
by nroshania - opened

Hoping to experiment with this model, does anyone know how much RAM and on disk memory is required to load this model? Thanks!

Google org

Hi @nroshania , We recommend a 8GB+ RAM on GPU for the 2B checkpoint and 24GB+ RAM on GPU for the 7B checkpoint. Please refer to this Gemma official document for more details in this. Thank you.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment