Update README.md
Browse files
README.md
CHANGED
@@ -85,8 +85,8 @@ and is comparable with Mistral-7B-Instruct-v0.1 on MMLU and MT-Bench in English.
|
|
85 |
|
86 |
|
87 |
## Inference Performance
|
88 |
-
In this test, we use the first
|
89 |
-
|
90 |
|
91 |
| Models | Speed (char/sec) |Estimated Max Input Length (TC Char)|
|
92 |
|--------------------------------------------------------------------|-------------------|--------------------------|
|
|
|
85 |
|
86 |
|
87 |
## Inference Performance
|
88 |
+
In this test, we use the first 700 characters a [web article](https://health.udn.com/health/story/5976/7699252?from=udn_ch1005_main_index) as input and ask the model to rewrite the article.
|
89 |
+
All models were inferenced with `vllm` on 2 A6000 (TP=2 ).
|
90 |
|
91 |
| Models | Speed (char/sec) |Estimated Max Input Length (TC Char)|
|
92 |
|--------------------------------------------------------------------|-------------------|--------------------------|
|