|
|
--- |
|
|
tags: |
|
|
- llama2 |
|
|
- llama2-7b |
|
|
- rkllm |
|
|
- rockchip |
|
|
- rk3588 |
|
|
--- |
|
|
|
|
|
# Llama 2 Chat 7B for RK3588 |
|
|
This is a conversion from https://huggingface.co/meta-llama/Llama-2-7b-chat-hf to the RKLLM format for Rockchip devices. |
|
|
This runs on the NPU from the RK3588. |
|
|
|
|
|
**Latest update:** April 2024. Converted with **RKLLM runtime 1.0.0**. Not compatible with newer versions |
|
|
|
|
|
# Main repo |
|
|
See this for my full collection of converted LLMs for the RK3588's NPU: |
|
|
|
|
|
https://huggingface.co/Pelochus/ezrkllm-collection |
|
|
|
|
|
# License |
|
|
Same as the original LLM: |
|
|
|
|
|
https://huggingface.co/meta-llama/Llama-2-7b-chat-hf/blob/main/LICENSE.txt |
