This is llama3-instrucTrans-8b-8k gptq version for vllm.
You can try it here http://nayohan.site
- Downloads last month
- 9
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.