Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
|
|
|
2 |
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
arxiv: 2103.06333
|
3 |
+
license: mit
|
4 |
+
language:
|
5 |
+
- code
|
6 |
+
---
|
7 |
|
8 |
+
This is an *unofficial* reupload of [uclanlp/plbart-large](https://huggingface.co/uclanlp/plbart-large) in the `SafeTensors` format using `transformers` `4.40.1`. The goal of this reupload is to prevent older models that are still relevant baselines from becoming stale as a result of changes in HuggingFace. Additionally, I may include minor corrections, such as model max length configuration.
|
9 |
|
10 |
+
Please see the [original repo](https://github.com/wasiahmad/PLBART) for more information.
|
11 |
+
|
12 |
+
Original model card below:
|
13 |
+
|
14 |
+
---
|
15 |
+
|
16 |
+
## PLBART is a Transformer model
|
17 |
+
|
18 |
+
- PLBART is a sequence-to-sequence model pre-trained on a large collection Java and Python functions and natural
|
19 |
+
language descriptions collected from Github and StackOverflow, respectively.
|
20 |
+
- PLBART is pre-trained via denoising autoencoding (DAE) and uses three noising strategies: token masking, token
|
21 |
+
deletion, and token infilling (shown below in the three examples).
|
22 |
+
|
23 |
+
<div align="center">
|
24 |
+
|
25 |
+
<table>
|
26 |
+
<thead>
|
27 |
+
<tr>
|
28 |
+
<th>Noisy Input</th>
|
29 |
+
<th>Original Sequence</th>
|
30 |
+
</tr>
|
31 |
+
</thead>
|
32 |
+
<tbody>
|
33 |
+
<tr>
|
34 |
+
<td>Is 0 the <strong>[MASK]</strong> Fibonacci <strong>[MASK]</strong> ? <em><En></em></td>
|
35 |
+
<td><em><En></em> Is 0 the <strong>first</strong> Fibonacci <strong>number</strong> ?</td>
|
36 |
+
</tr>
|
37 |
+
<tr>
|
38 |
+
<td>public static main ( String args [ ] ) { date = Date ( ) ;
|
39 |
+
System . out . ( String . format ( " Current Date : % tc " , ) ) ; } <em><java></em></td>
|
40 |
+
<td><em><java></em> public static <strong>void</strong> main ( String args [ ] ) { <strong>Date</strong> date = new Date ( ) ;
|
41 |
+
System . out . <strong>printf</strong> ( String . format ( " Current Date : % tc " , <strong>date</strong> ) ) ; }</td>
|
42 |
+
</tr>
|
43 |
+
<tr>
|
44 |
+
<td>def addThreeNumbers ( x , y , z ) : NEW_LINE INDENT return <strong>[MASK]</strong> <em><python></em></td>
|
45 |
+
<td><em><python></em> def addThreeNumbers ( x , y , z ) : NEW_LINE INDENT return <strong>x + y + z</strong></td>
|
46 |
+
</tr>
|
47 |
+
</tbody>
|
48 |
+
</table>
|
49 |
+
|
50 |
+
</div>
|