vedalken commited on
Commit
22ae3f6
1 Parent(s): 8e6c97d

empty cache after generating an image

Browse files

I found this workaround useful for using the interface locally.
Since i have only a 6GB GPU, i wasn't able to generate multiple images: after empty the cache i was able to generate as many image as i wanted.

I thought that this little trick can be useful for user with modest hardware like me that want to use the code locally.

Hope it helps!

Happy coding :)

Files changed (1) hide show
  1. app.py +2 -1
app.py CHANGED
@@ -184,6 +184,7 @@ def inference(
184
  "sampler": sampler,
185
  },
186
  )
 
187
 
188
  return out_image["images"][0], gr.update(visible=True), gr.update(visible=True), my_seed
189
 
@@ -274,7 +275,7 @@ with gr.Blocks(css=css) as app_with_history:
274
  app.render()
275
  with gr.Tab("Past generations"):
276
  user_history.render()
277
-
278
  app_with_history.queue(max_size=20,api_open=False )
279
 
280
  if __name__ == "__main__":
 
184
  "sampler": sampler,
185
  },
186
  )
187
+ torch.cuda.empty_cache()
188
 
189
  return out_image["images"][0], gr.update(visible=True), gr.update(visible=True), my_seed
190
 
 
275
  app.render()
276
  with gr.Tab("Past generations"):
277
  user_history.render()
278
+
279
  app_with_history.queue(max_size=20,api_open=False )
280
 
281
  if __name__ == "__main__":