Llama-genie-qnn / README.md
Davidqian123's picture
Create README.md
540e716 verified
These two models are converted from [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) and [meta-llama/Llama-3.2-3B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct) using `qai_hub_models`
These models are compatible with Snapdragon® X Elite device and QNN v2.28.2.241116
Tech flow: Genie SDK + QNN + Qualcomm AI Hub
Follow README in https://github.com/quic/ai-hub-apps/blob/main/tutorials/llm_on_genie/README.md#run-llm-on-device