license: llama3.1 | |
Just the Q3_K_L quantisation from [bullerwins' quantisation](https://huggingface.co/bullerwins/Meta-Llama-3.1-70B-Instruct-GGUF) | |
For use in VLLM |
license: llama3.1 | |
Just the Q3_K_L quantisation from [bullerwins' quantisation](https://huggingface.co/bullerwins/Meta-Llama-3.1-70B-Instruct-GGUF) | |
For use in VLLM |