Update README.md
Browse files
README.md
CHANGED
@@ -11,11 +11,18 @@ widget:
|
|
11 |
|
12 |
## Model description
|
13 |
|
14 |
-
This model is pre-trained by [UER-py](https://arxiv.org/abs/1909.05658).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
15 |
|
16 |
## How to use
|
17 |
|
18 |
-
You can use this model directly with a pipeline for text2text generation :
|
19 |
|
20 |
```python
|
21 |
>>> from transformers import BertTokenizer, PegasusForConditionalGeneration, Text2TextGenerationPipeline
|
@@ -28,7 +35,7 @@ You can use this model directly with a pipeline for text2text generation :
|
|
28 |
|
29 |
## Training data
|
30 |
|
31 |
-
[CLUECorpusSmall](https://github.com/CLUEbenchmark/CLUECorpus2020/) is used as training data.
|
32 |
|
33 |
## Training procedure
|
34 |
|
@@ -81,4 +88,7 @@ python3 scripts/convert_pegasus_from_uer_to_huggingface.py --input_model_path cl
|
|
81 |
pages={241},
|
82 |
year={2019}
|
83 |
}
|
84 |
-
```
|
|
|
|
|
|
|
|
11 |
|
12 |
## Model description
|
13 |
|
14 |
+
This model is pre-trained by [UER-py](https://github.com/dbiir/UER-py/), which is introduced in [this paper](https://arxiv.org/abs/1909.05658).
|
15 |
+
|
16 |
+
You can download the set of Chinese PEGASUS models either from the [UER-py Modelzoo page](https://github.com/dbiir/UER-py/wiki/Modelzoo), or via HuggingFace from the links below:
|
17 |
+
|
18 |
+
| | Link |
|
19 |
+
| ----------------- | :----------------------------: |
|
20 |
+
| **PEGASUS-Base** | [**L=12/H=768 (Small)**][base] |
|
21 |
+
| **PEGASUS-Large** | [**L=16/H=1024 (Base)**][large] |
|
22 |
|
23 |
## How to use
|
24 |
|
25 |
+
You can use this model directly with a pipeline for text2text generation (take the case of PEGASUS-Base):
|
26 |
|
27 |
```python
|
28 |
>>> from transformers import BertTokenizer, PegasusForConditionalGeneration, Text2TextGenerationPipeline
|
|
|
35 |
|
36 |
## Training data
|
37 |
|
38 |
+
[CLUECorpusSmall](https://github.com/CLUEbenchmark/CLUECorpus2020/) is used as training data.
|
39 |
|
40 |
## Training procedure
|
41 |
|
|
|
88 |
pages={241},
|
89 |
year={2019}
|
90 |
}
|
91 |
+
```
|
92 |
+
|
93 |
+
[base]:https://huggingface.co/uer/pegasus-base-chinese-cluecorpussmall
|
94 |
+
[large]:https://huggingface.co/uer/pegasus-large-chinese-cluecorpussmall
|