File size: 171 Bytes
6199ed5 |
1 2 3 4 5 6 |
---
license: llama3.1
---
Just the Q3_K_L quantisation from [bullerwins' quantisation](https://huggingface.co/bullerwins/Meta-Llama-3.1-70B-Instruct-GGUF)
For use in VLLM |
6199ed5 |
1 2 3 4 5 6 |
---
license: llama3.1
---
Just the Q3_K_L quantisation from [bullerwins' quantisation](https://huggingface.co/bullerwins/Meta-Llama-3.1-70B-Instruct-GGUF)
For use in VLLM |