yixinsong commited on
Commit
1b715b3
·
1 Parent(s): 7b9e42b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -59,7 +59,7 @@ We evaluate the model on the datasets of [Open LLM Leaderboard](https://huggingf
59
 
60
  ### Inference Tool
61
 
62
- We utilize [PowerInfer](https://github.com/SJTU-IPADS/PowerInfer) for inference, here we list the inference speed of pure CPU inference with fp16 precision.
63
 
64
  Dense Inference: 2.69 tokens/s
65
 
 
59
 
60
  ### Inference Tool
61
 
62
+ We utilize [PowerInfer](https://github.com/SJTU-IPADS/PowerInfer) for inference, here we present the inference speeds of pure CPU-based inference with fp16 precision.
63
 
64
  Dense Inference: 2.69 tokens/s
65