| base_model: GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct | |
| language: | |
| - en | |
| - id | |
| - jv | |
| - su | |
| license: llama3 | |
| tags: | |
| - llama-cpp | |
| - gguf | |
| # Supa-AI/llama3-8b-cpt-sahabatai-v1-instruct-gguf | |
| This model was converted to GGUF format from [`GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct`](https://huggingface.co/GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct) using llama.cpp. | |
| Refer to the [original model card](https://huggingface.co/GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct) for more details on the model. | |
| ## Available Versions | |
| - `llama3-8b-cpt-sahabatai-v1-instruct.q2_k.gguf` (q2_k) | |
| - `llama3-8b-cpt-sahabatai-v1-instruct.q3_k_m.gguf` (q3_k_m) | |
| - `llama3-8b-cpt-sahabatai-v1-instruct.q4_0.gguf` (q4_0) | |
| - `llama3-8b-cpt-sahabatai-v1-instruct.q4_k_m.gguf` (q4_k_m) | |
| - `llama3-8b-cpt-sahabatai-v1-instruct.q5_0.gguf` (q5_0) | |
| - `llama3-8b-cpt-sahabatai-v1-instruct.q5_k_m.gguf` (q5_k_m) | |
| - `llama3-8b-cpt-sahabatai-v1-instruct.q6_k.gguf` (q6_k) | |
| - `llama3-8b-cpt-sahabatai-v1-instruct.q8_0.gguf` (q8_0) | |
| ## Use with llama.cpp | |
| Replace `FILENAME` with one of the above filenames. | |
| ### CLI: | |
| ```bash | |
| llama-cli --hf-repo Supa-AI/llama3-8b-cpt-sahabatai-v1-instruct-gguf --hf-file FILENAME -p "Your prompt here" | |
| ``` | |
| ### Server: | |
| ```bash | |
| llama-server --hf-repo Supa-AI/llama3-8b-cpt-sahabatai-v1-instruct-gguf --hf-file FILENAME -c 2048 | |
| ``` | |
| ## Model Details | |
| - **Original Model:** [GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct](https://huggingface.co/GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct) | |
| - **Format:** GGUF | |