Update README.md
Browse files
README.md
CHANGED
@@ -177,10 +177,10 @@ Accuracy-norm score*
|
|
177 |
|
178 |
|Inference Tool/Hardware | A10 (tokens/sec) |
|
179 |
|:----------|:----------|
|
180 |
-
|
|
181 |
| Infery LLM | 2,029.6 |
|
182 |
|
183 |
-
- Throughput (tokens/sec) - Measured with optimal batch -
|
184 |
|
185 |
|
186 |
## How to Cite
|
|
|
177 |
|
178 |
|Inference Tool/Hardware | A10 (tokens/sec) |
|
179 |
|:----------|:----------|
|
180 |
+
| PyTorch | 652.49 |
|
181 |
| Infery LLM | 2,029.6 |
|
182 |
|
183 |
+
- Throughput (tokens/sec) - Measured with optimal batch - PyTorch BS 64, Infery LLM BS 128
|
184 |
|
185 |
|
186 |
## How to Cite
|