Hugging Face's logo

qualcomm
/
Llama-v3-8B-Chat

Text Generation
PyTorch
llm
generative_ai
quantized
android
Model card Files Community
2
qaihm-bot commited on
Commit
395fa13
•
1 Parent(s): 3509fe3

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -90,8 +90,8 @@ Response: Superposition is a fundamental concept in quantum mechanics, which is
90
 
91
  | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
92
  | ---|---|---|---|---|---|---|---|
93
- | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 72.856 ms | 1 - 1261 MB | UINT16 | NPU | Llama3-TokenGenerator-KVCache-Quantized
94
- | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 1316.502 ms | 0 - 979 MB | UINT16 | NPU | Llama3-PromptProcessor-Quantized
95
 
96
 
97
 
 
90
 
91
  | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
92
  | ---|---|---|---|---|---|---|---|
93
+ | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 99.315 ms | 33 - 35 MB | UINT16 | NPU | Llama3-TokenGenerator-KVCache-Quantized
94
+ | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 1807.176 ms | 11 - 13 MB | UINT16 | NPU | Llama3-PromptProcessor-Quantized
95
 
96
 
97