Update README.md
Browse files
README.md
CHANGED
|
@@ -60,7 +60,9 @@ We evaluate the model on the datasets of [Open LLM Leaderboard](https://huggingf
|
|
| 60 |
### Inference Tool
|
| 61 |
|
| 62 |
We utilize [PowerInfer](https://github.com/SJTU-IPADS/PowerInfer) for pure CPU inference.
|
|
|
|
| 63 |
Dense Inference: 2.69 tokens/s
|
|
|
|
| 64 |
Sparse Inference: 4.45 tokens/s
|
| 65 |
|
| 66 |
### License Disclaimer:
|
|
|
|
| 60 |
### Inference Tool
|
| 61 |
|
| 62 |
We utilize [PowerInfer](https://github.com/SJTU-IPADS/PowerInfer) for pure CPU inference.
|
| 63 |
+
|
| 64 |
Dense Inference: 2.69 tokens/s
|
| 65 |
+
|
| 66 |
Sparse Inference: 4.45 tokens/s
|
| 67 |
|
| 68 |
### License Disclaimer:
|