Update README.md
Browse files
README.md
CHANGED
@@ -85,8 +85,8 @@ and is comparable with Mistral-7B-Instruct-v0.1 on MMLU and MT-Bench in English.
|
|
85 |
|
86 |
|
87 |
## Inference Performance
|
88 |
-
In this test, we use the first 700 characters
|
89 |
-
All models were inferenced with `vllm` on 2 A6000 (TP=2
|
90 |
|
91 |
| Models | Inference Time (sec)|Estimated Max Input Length (TC Char)|
|
92 |
|--------------------------------------------------------------------|-------------------|--------------------------|
|
|
|
85 |
|
86 |
|
87 |
## Inference Performance
|
88 |
+
In this test, we use the first 700 characters of the [web article](https://health.udn.com/health/story/5976/7699252?from=udn_ch1005_main_index) as the input and ask the model to write the same article again.
|
89 |
+
All models were inferenced with `vllm` on 2 A6000 (TP=2).
|
90 |
|
91 |
| Models | Inference Time (sec)|Estimated Max Input Length (TC Char)|
|
92 |
|--------------------------------------------------------------------|-------------------|--------------------------|
|