Hugging Face's logo

Spaces:
CoderCowMoo
/
Llama-3-70b-Instruct-Orthoganalized
Runtime error

App Files Community
Llama-3-70b-Instruct-Orthoganalized / app.py

Commit History

problem with marlin_kernel step
5be4bff
verified

CoderCowMoo commited on

disable exllamav2 and use marlin
d23fc4b
verified

CoderCowMoo commited on

use_exllama=false?
cdcdc4e
verified

CoderCowMoo commited on

exactly like the exampe
f37371f
verified

CoderCowMoo commited on

forgot comma dumbass
2ebd075
verified

CoderCowMoo commited on

Might've been adding device= in wrong spot.
84b43c9
verified

CoderCowMoo commited on

No device, and cuda in the spaces function?
125b498
verified

CoderCowMoo commited on

Maybe auto device map
5e96c36
verified

CoderCowMoo commited on

Maybe remove device?
332c1a1
verified

CoderCowMoo commited on

change device to cuda:0 same as mazaiyahr's repo
606fa0a
verified

CoderCowMoo commited on

Change to use GPTQ so i dont get limited
3974b7a
verified

CoderCowMoo commited on

llama 3 dumbass
267b4cd
verified

CoderCowMoo commited on

import from transformers dumbass
4f77518
verified

CoderCowMoo commited on

Destroy default and add my own files
e9af225
verified

CoderCowMoo commited on

Duplicate from gradio-templates/chatbot
2f309cd
verified

CoderCowMoo pngwn HF staff commited on