pankajmathur

/

orca_mini_v3_7b

like 40

I somehow can't get it to work on my gpu, it is switching to ram everytime I run it. I tried initializing device map to cuda too, but to no avail. Anyone facing the same issue?