system requirements?
#8
by
Said2k
- opened
What is the minimum required to run this? I have 8GB of VRAM and 64GB of RAM
at least 20GB in 8bit
RAM or VRAM?
Technically, either, but you may need GPTQ (outside the scope of HuggingFace) to do it with RAM
You definitely will but it is runnable and there is a model that has been converted to ggml already. Details in other thread:
https://huggingface.co/chavinlo/gpt4-x-alpaca/discussions/7#6430803a1a8652d76a3e68b5