File size: 25,047 Bytes
78aa4ee
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
Steps: 1000	Loss: 117640.85156	PPL: 72.96771	bleu: 0.30677	LR: 0.00030000	*
Steps: 2000	Loss: 96072.33594	PPL: 33.23078	bleu: 1.44532	LR: 0.00030000	*
Steps: 3000	Loss: 86643.24219	PPL: 23.56177	bleu: 2.57306	LR: 0.00030000	*
Steps: 4000	Loss: 80421.35938	PPL: 18.77885	bleu: 3.81392	LR: 0.00030000	*
Steps: 5000	Loss: 75786.34375	PPL: 15.85851	bleu: 5.58060	LR: 0.00030000	*
Steps: 6000	Loss: 72432.73438	PPL: 14.03297	bleu: 6.41285	LR: 0.00030000	*
Steps: 7000	Loss: 70071.18750	PPL: 12.87504	bleu: 7.37862	LR: 0.00030000	*
Steps: 8000	Loss: 66923.03906	PPL: 11.47863	bleu: 8.53179	LR: 0.00030000	*
Steps: 9000	Loss: 64534.80078	PPL: 10.52123	bleu: 9.22430	LR: 0.00030000	*
Steps: 10000	Loss: 62539.73438	PPL: 9.78295	bleu: 10.64979	LR: 0.00030000	*
Steps: 11000	Loss: 60636.72656	PPL: 9.12706	bleu: 11.01825	LR: 0.00030000	*
Steps: 12000	Loss: 59227.60156	PPL: 8.66990	bleu: 11.86854	LR: 0.00030000	*
Steps: 13000	Loss: 58186.77344	PPL: 8.34699	bleu: 12.08454	LR: 0.00030000	*
Steps: 14000	Loss: 56896.06250	PPL: 7.96321	bleu: 12.99344	LR: 0.00030000	*
Steps: 15000	Loss: 55913.68359	PPL: 7.68298	bleu: 13.11308	LR: 0.00030000	*
Steps: 16000	Loss: 54779.15625	PPL: 7.37160	bleu: 13.97093	LR: 0.00030000	*
Steps: 17000	Loss: 54069.16406	PPL: 7.18319	bleu: 14.29817	LR: 0.00030000	*
Steps: 18000	Loss: 53412.51172	PPL: 7.01323	bleu: 14.81524	LR: 0.00030000	*
Steps: 19000	Loss: 52716.42969	PPL: 6.83744	bleu: 15.10384	LR: 0.00030000	*
Steps: 20000	Loss: 51864.33594	PPL: 6.62825	bleu: 15.79898	LR: 0.00030000	*
Steps: 21000	Loss: 51605.48438	PPL: 6.56597	bleu: 15.92662	LR: 0.00030000	*
Steps: 22000	Loss: 50841.44531	PPL: 6.38556	bleu: 15.37756	LR: 0.00030000	*
Steps: 23000	Loss: 50231.08203	PPL: 6.24500	bleu: 15.72780	LR: 0.00030000	*
Steps: 24000	Loss: 50051.07031	PPL: 6.20413	bleu: 16.73068	LR: 0.00030000	*
Steps: 25000	Loss: 49529.12109	PPL: 6.08716	bleu: 16.83326	LR: 0.00030000	*
Steps: 26000	Loss: 48766.23047	PPL: 5.92015	bleu: 16.67082	LR: 0.00030000	*
Steps: 27000	Loss: 48758.48047	PPL: 5.91848	bleu: 16.42519	LR: 0.00030000	*
Steps: 28000	Loss: 48517.66406	PPL: 5.86673	bleu: 17.09880	LR: 0.00030000	*
Steps: 29000	Loss: 47935.69141	PPL: 5.74353	bleu: 17.26956	LR: 0.00030000	*
Steps: 30000	Loss: 47536.41016	PPL: 5.66051	bleu: 18.17331	LR: 0.00030000	*
Steps: 31000	Loss: 47233.03125	PPL: 5.59823	bleu: 17.86630	LR: 0.00030000	*
Steps: 32000	Loss: 46845.16016	PPL: 5.51960	bleu: 17.55114	LR: 0.00030000	*
Steps: 33000	Loss: 46555.50391	PPL: 5.46161	bleu: 18.08572	LR: 0.00030000	*
Steps: 34000	Loss: 46314.35156	PPL: 5.41379	bleu: 18.53433	LR: 0.00030000	*
Steps: 35000	Loss: 46390.54297	PPL: 5.42885	bleu: 18.58724	LR: 0.00030000	
Steps: 36000	Loss: 45857.84375	PPL: 5.32441	bleu: 18.35147	LR: 0.00030000	*
Steps: 37000	Loss: 45609.14062	PPL: 5.27634	bleu: 19.16506	LR: 0.00030000	*
Steps: 38000	Loss: 45250.14062	PPL: 5.20771	bleu: 19.12660	LR: 0.00030000	*
Steps: 39000	Loss: 45008.28906	PPL: 5.16198	bleu: 19.13025	LR: 0.00030000	*
Steps: 40000	Loss: 44927.48828	PPL: 5.14679	bleu: 19.26860	LR: 0.00030000	*
Steps: 41000	Loss: 44799.68750	PPL: 5.12286	bleu: 19.82229	LR: 0.00030000	*
Steps: 42000	Loss: 44595.99219	PPL: 5.08495	bleu: 20.07113	LR: 0.00030000	*
Steps: 43000	Loss: 44518.01562	PPL: 5.07051	bleu: 20.15304	LR: 0.00030000	*
Steps: 44000	Loss: 44604.22656	PPL: 5.08648	bleu: 19.50764	LR: 0.00030000	
Steps: 45000	Loss: 44226.59766	PPL: 5.01691	bleu: 19.81995	LR: 0.00030000	*
Steps: 46000	Loss: 43740.90625	PPL: 4.92883	bleu: 19.78123	LR: 0.00030000	*
Steps: 47000	Loss: 43917.57031	PPL: 4.96069	bleu: 20.11571	LR: 0.00030000	
Steps: 48000	Loss: 43837.21484	PPL: 4.94618	bleu: 20.30522	LR: 0.00030000	
Steps: 49000	Loss: 43333.14062	PPL: 4.85609	bleu: 20.59117	LR: 0.00030000	*
Steps: 50000	Loss: 43285.43750	PPL: 4.84765	bleu: 20.42034	LR: 0.00030000	*
Steps: 51000	Loss: 43450.50391	PPL: 4.87691	bleu: 20.42331	LR: 0.00030000	
Steps: 52000	Loss: 43048.57031	PPL: 4.80595	bleu: 20.58515	LR: 0.00030000	*
Steps: 53000	Loss: 42810.62891	PPL: 4.76443	bleu: 21.11798	LR: 0.00030000	*
Steps: 54000	Loss: 42952.18359	PPL: 4.78909	bleu: 20.62784	LR: 0.00030000	
Steps: 55000	Loss: 42560.89453	PPL: 4.72124	bleu: 21.44503	LR: 0.00030000	*
Steps: 56000	Loss: 42400.73047	PPL: 4.69374	bleu: 21.26521	LR: 0.00030000	*
Steps: 57000	Loss: 42210.21875	PPL: 4.66125	bleu: 21.31058	LR: 0.00030000	*
Steps: 58000	Loss: 41979.88281	PPL: 4.62226	bleu: 21.67745	LR: 0.00030000	*
Steps: 59000	Loss: 42282.56250	PPL: 4.67356	bleu: 20.84804	LR: 0.00030000	
Steps: 60000	Loss: 42053.80859	PPL: 4.63474	bleu: 21.18251	LR: 0.00030000	
Steps: 61000	Loss: 41909.87109	PPL: 4.61047	bleu: 21.62524	LR: 0.00030000	*
Steps: 62000	Loss: 41541.15234	PPL: 4.54889	bleu: 21.41595	LR: 0.00030000	*
Steps: 63000	Loss: 41558.26562	PPL: 4.55173	bleu: 21.00293	LR: 0.00030000	
Steps: 64000	Loss: 41908.83594	PPL: 4.61030	bleu: 20.85890	LR: 0.00030000	
Steps: 65000	Loss: 41520.91406	PPL: 4.54554	bleu: 21.73595	LR: 0.00030000	*
Steps: 66000	Loss: 41346.65234	PPL: 4.51674	bleu: 22.21506	LR: 0.00030000	*
Steps: 67000	Loss: 41329.91406	PPL: 4.51399	bleu: 21.81378	LR: 0.00030000	*
Steps: 68000	Loss: 41089.80469	PPL: 4.47464	bleu: 21.86928	LR: 0.00030000	*
Steps: 69000	Loss: 40997.83594	PPL: 4.45965	bleu: 21.69884	LR: 0.00030000	*
Steps: 70000	Loss: 40979.94922	PPL: 4.45675	bleu: 22.22275	LR: 0.00030000	*
Steps: 71000	Loss: 40638.07422	PPL: 4.40153	bleu: 22.29289	LR: 0.00030000	*
Steps: 72000	Loss: 40649.71094	PPL: 4.40339	bleu: 22.32089	LR: 0.00030000	
Steps: 73000	Loss: 40593.98438	PPL: 4.39446	bleu: 22.30915	LR: 0.00030000	*
Steps: 74000	Loss: 40460.03906	PPL: 4.37304	bleu: 21.92129	LR: 0.00030000	*
Steps: 75000	Loss: 40404.48047	PPL: 4.36419	bleu: 21.79802	LR: 0.00030000	*
Steps: 76000	Loss: 40453.14844	PPL: 4.37194	bleu: 22.09940	LR: 0.00030000	
Steps: 77000	Loss: 40387.22656	PPL: 4.36145	bleu: 21.99121	LR: 0.00030000	*
Steps: 78000	Loss: 40202.97266	PPL: 4.33224	bleu: 22.53978	LR: 0.00030000	*
Steps: 79000	Loss: 40027.13281	PPL: 4.30455	bleu: 22.49454	LR: 0.00030000	*
Steps: 80000	Loss: 40222.30859	PPL: 4.33530	bleu: 22.94402	LR: 0.00030000	
Steps: 81000	Loss: 40111.26562	PPL: 4.31778	bleu: 22.34369	LR: 0.00030000	
Steps: 82000	Loss: 39987.89062	PPL: 4.29839	bleu: 22.51628	LR: 0.00030000	*
Steps: 83000	Loss: 39887.67188	PPL: 4.28271	bleu: 22.14228	LR: 0.00030000	*
Steps: 84000	Loss: 39712.21484	PPL: 4.25540	bleu: 22.63713	LR: 0.00030000	*
Steps: 85000	Loss: 39699.52734	PPL: 4.25343	bleu: 22.54750	LR: 0.00030000	*
Steps: 86000	Loss: 39822.35547	PPL: 4.27252	bleu: 22.83256	LR: 0.00030000	
Steps: 87000	Loss: 40062.01562	PPL: 4.31003	bleu: 22.34735	LR: 0.00030000	
Steps: 88000	Loss: 39588.43359	PPL: 4.23623	bleu: 22.43288	LR: 0.00030000	*
Steps: 89000	Loss: 39368.09375	PPL: 4.20233	bleu: 22.83976	LR: 0.00030000	*
Steps: 90000	Loss: 39452.43750	PPL: 4.21528	bleu: 21.94867	LR: 0.00030000	
Steps: 91000	Loss: 39252.95312	PPL: 4.18472	bleu: 22.79975	LR: 0.00030000	*
Steps: 92000	Loss: 39196.74609	PPL: 4.17615	bleu: 22.47131	LR: 0.00030000	*
Steps: 93000	Loss: 39379.62109	PPL: 4.20410	bleu: 23.16096	LR: 0.00030000	
Steps: 94000	Loss: 39322.86328	PPL: 4.19540	bleu: 23.20399	LR: 0.00030000	
Steps: 95000	Loss: 39088.82422	PPL: 4.15975	bleu: 22.83810	LR: 0.00030000	*
Steps: 96000	Loss: 39075.79297	PPL: 4.15777	bleu: 22.98239	LR: 0.00030000	*
Steps: 97000	Loss: 39133.95703	PPL: 4.16660	bleu: 22.73311	LR: 0.00030000	
Steps: 98000	Loss: 38947.16016	PPL: 4.13832	bleu: 23.27105	LR: 0.00030000	*
Steps: 99000	Loss: 38822.62109	PPL: 4.11956	bleu: 23.34243	LR: 0.00030000	*
Steps: 100000	Loss: 38824.01172	PPL: 4.11977	bleu: 23.30457	LR: 0.00030000	
Steps: 101000	Loss: 38837.08594	PPL: 4.12174	bleu: 23.17570	LR: 0.00030000	
Steps: 102000	Loss: 38938.53906	PPL: 4.13701	bleu: 22.97706	LR: 0.00030000	
Steps: 103000	Loss: 38957.83594	PPL: 4.13993	bleu: 23.61245	LR: 0.00030000	
Steps: 104000	Loss: 38770.32031	PPL: 4.11171	bleu: 23.16266	LR: 0.00030000	*
Steps: 105000	Loss: 38532.46094	PPL: 4.07620	bleu: 23.47833	LR: 0.00030000	*
Steps: 106000	Loss: 38456.90234	PPL: 4.06499	bleu: 23.20398	LR: 0.00030000	*
Steps: 107000	Loss: 38603.00391	PPL: 4.08670	bleu: 23.47297	LR: 0.00030000	
Steps: 108000	Loss: 38609.84766	PPL: 4.08772	bleu: 23.35263	LR: 0.00030000	
Steps: 109000	Loss: 38276.45703	PPL: 4.03833	bleu: 23.29704	LR: 0.00030000	*
Steps: 110000	Loss: 38438.14844	PPL: 4.06221	bleu: 23.33509	LR: 0.00030000	
Steps: 111000	Loss: 38361.06641	PPL: 4.05081	bleu: 23.13661	LR: 0.00030000	
Steps: 112000	Loss: 38283.51953	PPL: 4.03937	bleu: 23.53948	LR: 0.00030000	
Steps: 113000	Loss: 38362.33203	PPL: 4.05099	bleu: 23.79189	LR: 0.00030000	
Steps: 114000	Loss: 38306.84375	PPL: 4.04280	bleu: 23.46887	LR: 0.00030000	
Steps: 115000	Loss: 38309.89062	PPL: 4.04325	bleu: 23.60850	LR: 0.00021000	
Steps: 116000	Loss: 37960.96094	PPL: 3.99213	bleu: 23.91608	LR: 0.00021000	*
Steps: 117000	Loss: 37655.19141	PPL: 3.94786	bleu: 24.11143	LR: 0.00021000	*
Steps: 118000	Loss: 37697.53516	PPL: 3.95396	bleu: 24.29110	LR: 0.00021000	
Steps: 119000	Loss: 37641.87109	PPL: 3.94595	bleu: 24.17020	LR: 0.00021000	*
Steps: 120000	Loss: 37560.46484	PPL: 3.93425	bleu: 24.39688	LR: 0.00021000	*
Steps: 121000	Loss: 37624.74219	PPL: 3.94348	bleu: 24.20204	LR: 0.00021000	
Steps: 122000	Loss: 37552.70312	PPL: 3.93314	bleu: 24.42698	LR: 0.00021000	*
Steps: 123000	Loss: 37381.46094	PPL: 3.90865	bleu: 24.14535	LR: 0.00021000	*
Steps: 124000	Loss: 37220.84375	PPL: 3.88582	bleu: 24.34294	LR: 0.00021000	*
Steps: 125000	Loss: 37309.18359	PPL: 3.89836	bleu: 24.19451	LR: 0.00021000	
Steps: 126000	Loss: 37437.84375	PPL: 3.91670	bleu: 24.28214	LR: 0.00021000	
Steps: 127000	Loss: 37437.23828	PPL: 3.91661	bleu: 24.48442	LR: 0.00021000	
Steps: 128000	Loss: 37348.47656	PPL: 3.90395	bleu: 24.28723	LR: 0.00021000	
Steps: 129000	Loss: 37299.30859	PPL: 3.89696	bleu: 24.35202	LR: 0.00021000	
Steps: 130000	Loss: 37234.72656	PPL: 3.88779	bleu: 24.38600	LR: 0.00014700	
Steps: 131000	Loss: 37061.83594	PPL: 3.86336	bleu: 24.46883	LR: 0.00014700	*
Steps: 132000	Loss: 37086.16797	PPL: 3.86679	bleu: 24.52761	LR: 0.00014700	
Steps: 133000	Loss: 36999.10938	PPL: 3.85453	bleu: 24.58185	LR: 0.00014700	*
Steps: 134000	Loss: 36962.12109	PPL: 3.84933	bleu: 24.46629	LR: 0.00014700	*
Steps: 135000	Loss: 36922.65625	PPL: 3.84380	bleu: 24.36102	LR: 0.00014700	*
Steps: 136000	Loss: 36878.20703	PPL: 3.83757	bleu: 24.37975	LR: 0.00014700	*
Steps: 137000	Loss: 36916.43359	PPL: 3.84293	bleu: 24.41530	LR: 0.00014700	
Steps: 138000	Loss: 36898.53516	PPL: 3.84042	bleu: 24.52885	LR: 0.00014700	
Steps: 139000	Loss: 36940.47656	PPL: 3.84630	bleu: 24.83388	LR: 0.00014700	
Steps: 140000	Loss: 36760.76953	PPL: 3.82117	bleu: 24.47324	LR: 0.00014700	*
Steps: 141000	Loss: 36679.84375	PPL: 3.80991	bleu: 24.48144	LR: 0.00014700	*
Steps: 142000	Loss: 36667.66797	PPL: 3.80822	bleu: 24.54077	LR: 0.00014700	*
Steps: 143000	Loss: 36604.52344	PPL: 3.79946	bleu: 24.85794	LR: 0.00014700	*
Steps: 144000	Loss: 36542.67188	PPL: 3.79090	bleu: 24.98253	LR: 0.00014700	*
Steps: 145000	Loss: 36595.04297	PPL: 3.79815	bleu: 24.29744	LR: 0.00014700	
Steps: 146000	Loss: 36662.24219	PPL: 3.80747	bleu: 24.54266	LR: 0.00014700	
Steps: 147000	Loss: 36561.60156	PPL: 3.79352	bleu: 24.46781	LR: 0.00014700	
Steps: 148000	Loss: 36614.99609	PPL: 3.80091	bleu: 24.48913	LR: 0.00014700	
Steps: 149000	Loss: 36561.30469	PPL: 3.79348	bleu: 24.94186	LR: 0.00014700	
Steps: 150000	Loss: 36491.22656	PPL: 3.78380	bleu: 24.99520	LR: 0.00014700	*
Steps: 151000	Loss: 36484.06250	PPL: 3.78281	bleu: 24.98294	LR: 0.00014700	*
Steps: 152000	Loss: 36548.77734	PPL: 3.79175	bleu: 24.97116	LR: 0.00014700	
Steps: 153000	Loss: 36639.71875	PPL: 3.80434	bleu: 24.74850	LR: 0.00014700	
Steps: 154000	Loss: 36502.16406	PPL: 3.78531	bleu: 24.82869	LR: 0.00014700	
Steps: 155000	Loss: 36509.69141	PPL: 3.78635	bleu: 24.85599	LR: 0.00014700	
Steps: 156000	Loss: 36460.94141	PPL: 3.77962	bleu: 25.16878	LR: 0.00014700	*
Steps: 157000	Loss: 36453.02734	PPL: 3.77853	bleu: 24.95815	LR: 0.00014700	*
Steps: 158000	Loss: 36384.28516	PPL: 3.76907	bleu: 24.53031	LR: 0.00014700	*
Steps: 159000	Loss: 36332.47656	PPL: 3.76196	bleu: 24.91550	LR: 0.00014700	*
Steps: 160000	Loss: 36493.85547	PPL: 3.78416	bleu: 24.87724	LR: 0.00014700	
Steps: 161000	Loss: 36376.48438	PPL: 3.76800	bleu: 24.68776	LR: 0.00014700	
Steps: 162000	Loss: 36424.84375	PPL: 3.77465	bleu: 24.74693	LR: 0.00014700	
Steps: 163000	Loss: 36359.21094	PPL: 3.76563	bleu: 24.69640	LR: 0.00014700	
Steps: 164000	Loss: 36271.67578	PPL: 3.75362	bleu: 24.77857	LR: 0.00014700	*
Steps: 165000	Loss: 36375.67188	PPL: 3.76789	bleu: 24.67269	LR: 0.00014700	
Steps: 166000	Loss: 36461.55469	PPL: 3.77971	bleu: 24.71124	LR: 0.00014700	
Steps: 167000	Loss: 36372.73438	PPL: 3.76748	bleu: 24.73632	LR: 0.00014700	
Steps: 168000	Loss: 36355.90625	PPL: 3.76517	bleu: 25.01684	LR: 0.00014700	
Steps: 169000	Loss: 36412.28125	PPL: 3.77292	bleu: 24.76650	LR: 0.00014700	
Steps: 170000	Loss: 36317.55469	PPL: 3.75991	bleu: 24.92523	LR: 0.00010290	
Steps: 171000	Loss: 36043.25000	PPL: 3.72249	bleu: 24.96350	LR: 0.00010290	*
Steps: 172000	Loss: 36103.58203	PPL: 3.73068	bleu: 24.84813	LR: 0.00010290	
Steps: 173000	Loss: 36121.60156	PPL: 3.73314	bleu: 25.06479	LR: 0.00010290	
Steps: 174000	Loss: 36071.19531	PPL: 3.72628	bleu: 25.06656	LR: 0.00010290	
Steps: 175000	Loss: 36063.15234	PPL: 3.72519	bleu: 25.28761	LR: 0.00010290	
Steps: 176000	Loss: 36012.24219	PPL: 3.71828	bleu: 25.34094	LR: 0.00010290	*
Steps: 177000	Loss: 35980.06641	PPL: 3.71392	bleu: 25.20632	LR: 0.00010290	*
Steps: 178000	Loss: 36025.92188	PPL: 3.72013	bleu: 25.18255	LR: 0.00010290	
Steps: 179000	Loss: 36144.85938	PPL: 3.73630	bleu: 25.06112	LR: 0.00010290	
Steps: 180000	Loss: 36131.77344	PPL: 3.73452	bleu: 25.38790	LR: 0.00010290	
Steps: 181000	Loss: 35972.75000	PPL: 3.71293	bleu: 25.33007	LR: 0.00010290	*
Steps: 182000	Loss: 35942.91016	PPL: 3.70889	bleu: 25.16205	LR: 0.00010290	*
Steps: 183000	Loss: 35833.89062	PPL: 3.69417	bleu: 25.27872	LR: 0.00010290	*
Steps: 184000	Loss: 35872.78516	PPL: 3.69942	bleu: 25.20647	LR: 0.00010290	
Steps: 185000	Loss: 35922.33984	PPL: 3.70611	bleu: 25.43258	LR: 0.00010290	
Steps: 186000	Loss: 35907.48047	PPL: 3.70410	bleu: 25.34363	LR: 0.00010290	
Steps: 187000	Loss: 35939.73438	PPL: 3.70846	bleu: 25.34075	LR: 0.00010290	
Steps: 188000	Loss: 35964.09766	PPL: 3.71176	bleu: 25.07352	LR: 0.00010290	
Steps: 189000	Loss: 35909.78906	PPL: 3.70441	bleu: 25.04680	LR: 0.00007203	
Steps: 190000	Loss: 35842.04297	PPL: 3.69527	bleu: 25.47323	LR: 0.00007203	
Steps: 191000	Loss: 35747.55078	PPL: 3.68256	bleu: 25.37858	LR: 0.00007203	*
Steps: 192000	Loss: 35875.65234	PPL: 3.69980	bleu: 25.47796	LR: 0.00007203	
Steps: 193000	Loss: 35835.31250	PPL: 3.69437	bleu: 25.38831	LR: 0.00007203	
Steps: 194000	Loss: 35702.88281	PPL: 3.67657	bleu: 25.56399	LR: 0.00007203	*
Steps: 195000	Loss: 35749.02344	PPL: 3.68276	bleu: 25.74306	LR: 0.00007203	
Steps: 196000	Loss: 35704.27344	PPL: 3.67675	bleu: 25.38217	LR: 0.00007203	
Steps: 197000	Loss: 35716.71484	PPL: 3.67842	bleu: 25.18610	LR: 0.00007203	
Steps: 198000	Loss: 35761.97656	PPL: 3.68450	bleu: 25.33143	LR: 0.00007203	
Steps: 199000	Loss: 35756.05469	PPL: 3.68370	bleu: 25.74991	LR: 0.00007203	
Steps: 200000	Loss: 35688.59766	PPL: 3.67465	bleu: 25.75004	LR: 0.00007203	*
Steps: 201000	Loss: 35739.53516	PPL: 3.68148	bleu: 25.44715	LR: 0.00007203	
Steps: 202000	Loss: 35684.76172	PPL: 3.67414	bleu: 25.32426	LR: 0.00007203	*
Steps: 203000	Loss: 35700.25000	PPL: 3.67621	bleu: 25.16456	LR: 0.00007203	
Steps: 204000	Loss: 35610.13672	PPL: 3.66415	bleu: 25.55833	LR: 0.00007203	*
Steps: 205000	Loss: 35649.66016	PPL: 3.66944	bleu: 25.31584	LR: 0.00007203	
Steps: 206000	Loss: 35577.99609	PPL: 3.65986	bleu: 25.19733	LR: 0.00007203	*
Steps: 207000	Loss: 35679.30078	PPL: 3.67341	bleu: 25.37284	LR: 0.00007203	
Steps: 208000	Loss: 35739.56250	PPL: 3.68149	bleu: 25.44612	LR: 0.00007203	
Steps: 209000	Loss: 35686.53906	PPL: 3.67438	bleu: 25.63467	LR: 0.00007203	
Steps: 210000	Loss: 35634.19531	PPL: 3.66737	bleu: 25.72294	LR: 0.00007203	
Steps: 211000	Loss: 35625.22266	PPL: 3.66617	bleu: 25.87567	LR: 0.00007203	
Steps: 212000	Loss: 35664.34766	PPL: 3.67140	bleu: 25.52055	LR: 0.00005042	
Steps: 213000	Loss: 35665.66406	PPL: 3.67158	bleu: 25.55837	LR: 0.00005042	
Steps: 214000	Loss: 35597.09375	PPL: 3.66241	bleu: 25.66390	LR: 0.00005042	
Steps: 215000	Loss: 35623.94531	PPL: 3.66600	bleu: 25.36372	LR: 0.00005042	
Steps: 216000	Loss: 35603.84375	PPL: 3.66331	bleu: 25.95028	LR: 0.00005042	
Steps: 217000	Loss: 35519.12891	PPL: 3.65201	bleu: 25.81568	LR: 0.00005042	*
Steps: 218000	Loss: 35638.73828	PPL: 3.66798	bleu: 25.58719	LR: 0.00005042	
Steps: 219000	Loss: 35581.85547	PPL: 3.66038	bleu: 25.82997	LR: 0.00005042	
Steps: 220000	Loss: 35643.37109	PPL: 3.66860	bleu: 25.62460	LR: 0.00005042	
Steps: 221000	Loss: 35576.58984	PPL: 3.65967	bleu: 25.86560	LR: 0.00005042	
Steps: 222000	Loss: 35553.89062	PPL: 3.65665	bleu: 25.67420	LR: 0.00005042	
Steps: 223000	Loss: 35619.74219	PPL: 3.66544	bleu: 25.80206	LR: 0.00003529	
Steps: 224000	Loss: 35567.75391	PPL: 3.65849	bleu: 25.51542	LR: 0.00003529	
Steps: 225000	Loss: 35567.85938	PPL: 3.65851	bleu: 25.53790	LR: 0.00003529	
Steps: 226000	Loss: 35533.30078	PPL: 3.65390	bleu: 25.72201	LR: 0.00003529	
Steps: 227000	Loss: 35559.82812	PPL: 3.65744	bleu: 25.67272	LR: 0.00003529	
Steps: 228000	Loss: 35508.69922	PPL: 3.65062	bleu: 25.86938	LR: 0.00003529	*
Steps: 229000	Loss: 35484.63281	PPL: 3.64742	bleu: 25.64464	LR: 0.00003529	*
Steps: 230000	Loss: 35476.83203	PPL: 3.64638	bleu: 25.83657	LR: 0.00003529	*
Steps: 231000	Loss: 35483.20703	PPL: 3.64723	bleu: 25.76319	LR: 0.00003529	
Steps: 232000	Loss: 35485.14062	PPL: 3.64749	bleu: 25.60255	LR: 0.00003529	
Steps: 233000	Loss: 35461.79688	PPL: 3.64439	bleu: 25.84748	LR: 0.00003529	*
Steps: 234000	Loss: 35489.69922	PPL: 3.64810	bleu: 25.79881	LR: 0.00003529	
Steps: 235000	Loss: 35455.02734	PPL: 3.64349	bleu: 25.69962	LR: 0.00003529	*
Steps: 236000	Loss: 35423.60156	PPL: 3.63931	bleu: 25.81471	LR: 0.00003529	*
Steps: 237000	Loss: 35407.42578	PPL: 3.63717	bleu: 25.82644	LR: 0.00003529	*
Steps: 238000	Loss: 35434.66016	PPL: 3.64078	bleu: 25.87317	LR: 0.00003529	
Steps: 239000	Loss: 35453.43359	PPL: 3.64327	bleu: 25.70927	LR: 0.00003529	
Steps: 240000	Loss: 35449.62891	PPL: 3.64277	bleu: 25.96945	LR: 0.00003529	
Steps: 241000	Loss: 35425.10547	PPL: 3.63951	bleu: 25.91304	LR: 0.00003529	
Steps: 242000	Loss: 35392.91406	PPL: 3.63524	bleu: 25.73983	LR: 0.00003529	*
Steps: 243000	Loss: 35437.17969	PPL: 3.64112	bleu: 25.91283	LR: 0.00003529	
Steps: 244000	Loss: 35421.46484	PPL: 3.63903	bleu: 25.91689	LR: 0.00003529	
Steps: 245000	Loss: 35428.33594	PPL: 3.63994	bleu: 25.90972	LR: 0.00003529	
Steps: 246000	Loss: 35377.39844	PPL: 3.63319	bleu: 25.93869	LR: 0.00003529	*
Steps: 247000	Loss: 35405.59375	PPL: 3.63692	bleu: 26.04868	LR: 0.00003529	
Steps: 248000	Loss: 35375.14062	PPL: 3.63289	bleu: 25.80345	LR: 0.00003529	*
Steps: 249000	Loss: 35376.50781	PPL: 3.63307	bleu: 25.79546	LR: 0.00003529	
Steps: 250000	Loss: 35368.60547	PPL: 3.63202	bleu: 25.83619	LR: 0.00003529	*
Steps: 251000	Loss: 35431.45312	PPL: 3.64036	bleu: 25.98045	LR: 0.00003529	
Steps: 252000	Loss: 35397.84766	PPL: 3.63590	bleu: 25.62282	LR: 0.00003529	
Steps: 253000	Loss: 35396.73828	PPL: 3.63575	bleu: 25.91349	LR: 0.00003529	
Steps: 254000	Loss: 35400.69531	PPL: 3.63627	bleu: 25.79404	LR: 0.00003529	
Steps: 255000	Loss: 35373.83984	PPL: 3.63271	bleu: 26.00488	LR: 0.00003529	
Steps: 256000	Loss: 35343.31641	PPL: 3.62867	bleu: 25.74574	LR: 0.00003529	*
Steps: 257000	Loss: 35338.04688	PPL: 3.62798	bleu: 25.90427	LR: 0.00003529	*
Steps: 258000	Loss: 35363.99219	PPL: 3.63141	bleu: 25.88810	LR: 0.00003529	
Steps: 259000	Loss: 35352.41797	PPL: 3.62988	bleu: 25.90165	LR: 0.00003529	
Steps: 260000	Loss: 35439.44141	PPL: 3.64142	bleu: 25.66819	LR: 0.00003529	
Steps: 261000	Loss: 35396.10938	PPL: 3.63567	bleu: 25.83850	LR: 0.00003529	
Steps: 262000	Loss: 35398.69531	PPL: 3.63601	bleu: 25.84636	LR: 0.00003529	
Steps: 263000	Loss: 35370.63672	PPL: 3.63229	bleu: 25.90844	LR: 0.00002471	
Steps: 264000	Loss: 35358.55078	PPL: 3.63069	bleu: 25.96816	LR: 0.00002471	
Steps: 265000	Loss: 35425.92969	PPL: 3.63962	bleu: 25.88694	LR: 0.00002471	
Steps: 266000	Loss: 35360.87109	PPL: 3.63100	bleu: 25.80898	LR: 0.00002471	
Steps: 267000	Loss: 35337.44141	PPL: 3.62790	bleu: 25.80653	LR: 0.00002471	*
Steps: 268000	Loss: 35329.75000	PPL: 3.62688	bleu: 25.90971	LR: 0.00002471	*
Steps: 269000	Loss: 35331.60547	PPL: 3.62712	bleu: 25.79087	LR: 0.00002471	
Steps: 270000	Loss: 35331.38281	PPL: 3.62709	bleu: 25.65772	LR: 0.00002471	
Steps: 271000	Loss: 35319.31641	PPL: 3.62550	bleu: 25.89009	LR: 0.00002471	*
Steps: 272000	Loss: 35348.19531	PPL: 3.62932	bleu: 25.68393	LR: 0.00002471	
Steps: 273000	Loss: 35379.81250	PPL: 3.63351	bleu: 25.81655	LR: 0.00002471	
Steps: 274000	Loss: 35338.38281	PPL: 3.62802	bleu: 26.01635	LR: 0.00002471	
Steps: 275000	Loss: 35330.26172	PPL: 3.62695	bleu: 25.76188	LR: 0.00002471	
Steps: 276000	Loss: 35310.36328	PPL: 3.62432	bleu: 25.75515	LR: 0.00002471	*
Steps: 277000	Loss: 35343.89844	PPL: 3.62875	bleu: 25.74876	LR: 0.00002471	
Steps: 278000	Loss: 35353.27344	PPL: 3.62999	bleu: 25.71972	LR: 0.00002471	
Steps: 279000	Loss: 35332.88281	PPL: 3.62729	bleu: 25.90659	LR: 0.00002471	
Steps: 280000	Loss: 35312.08594	PPL: 3.62454	bleu: 25.60473	LR: 0.00002471	
Steps: 281000	Loss: 35333.80859	PPL: 3.62742	bleu: 25.91967	LR: 0.00002471	
Steps: 282000	Loss: 35300.64453	PPL: 3.62303	bleu: 25.89667	LR: 0.00002471	*
Steps: 283000	Loss: 35319.14453	PPL: 3.62548	bleu: 26.05449	LR: 0.00002471	
Steps: 284000	Loss: 35365.10547	PPL: 3.63156	bleu: 25.90026	LR: 0.00002471	
Steps: 285000	Loss: 35332.06641	PPL: 3.62719	bleu: 25.64572	LR: 0.00002471	
Steps: 286000	Loss: 35323.89844	PPL: 3.62611	bleu: 26.15120	LR: 0.00002471	
Steps: 287000	Loss: 35337.85156	PPL: 3.62795	bleu: 26.19771	LR: 0.00002471	
Steps: 288000	Loss: 35300.11719	PPL: 3.62296	bleu: 25.95003	LR: 0.00001729	*
Steps: 289000	Loss: 35303.08594	PPL: 3.62335	bleu: 26.02795	LR: 0.00001729	
Steps: 290000	Loss: 35299.01562	PPL: 3.62282	bleu: 25.72550	LR: 0.00001729	*
Steps: 291000	Loss: 35309.21094	PPL: 3.62416	bleu: 26.04127	LR: 0.00001729	
Steps: 292000	Loss: 35323.38281	PPL: 3.62604	bleu: 25.81217	LR: 0.00001729	
Steps: 293000	Loss: 35329.21875	PPL: 3.62681	bleu: 25.92504	LR: 0.00001729	
Steps: 294000	Loss: 35307.49219	PPL: 3.62394	bleu: 26.25329	LR: 0.00001729	
Steps: 295000	Loss: 35322.02734	PPL: 3.62586	bleu: 25.98322	LR: 0.00001729	
Steps: 296000	Loss: 35290.26172	PPL: 3.62166	bleu: 26.09704	LR: 0.00001729	*
Steps: 297000	Loss: 35309.61719	PPL: 3.62422	bleu: 25.81555	LR: 0.00001729	
Steps: 298000	Loss: 35329.49219	PPL: 3.62684	bleu: 25.85845	LR: 0.00001729	
Steps: 299000	Loss: 35333.42578	PPL: 3.62736	bleu: 25.99118	LR: 0.00001729	
Steps: 300000	Loss: 35281.97656	PPL: 3.62057	bleu: 25.96553	LR: 0.00001729	*
Steps: 301000	Loss: 35289.00391	PPL: 3.62149	bleu: 25.89258	LR: 0.00001729	
Steps: 302000	Loss: 35280.84375	PPL: 3.62042	bleu: 25.94691	LR: 0.00001729	*
Steps: 303000	Loss: 35303.23438	PPL: 3.62337	bleu: 25.82628	LR: 0.00001729	
Steps: 304000	Loss: 35337.96875	PPL: 3.62797	bleu: 25.89150	LR: 0.00001729	
Steps: 305000	Loss: 35304.55859	PPL: 3.62355	bleu: 25.72649	LR: 0.00001729	
Steps: 306000	Loss: 35301.97656	PPL: 3.62321	bleu: 25.93105	LR: 0.00001729	
Steps: 307000	Loss: 35305.79688	PPL: 3.62371	bleu: 25.91836	LR: 0.00001729	
Steps: 308000	Loss: 35314.07031	PPL: 3.62481	bleu: 25.67593	LR: 0.00001211	
Steps: 309000	Loss: 35292.78125	PPL: 3.62199	bleu: 25.94088	LR: 0.00001211	
Steps: 310000	Loss: 35293.79688	PPL: 3.62213	bleu: 26.05686	LR: 0.00001211	
Steps: 311000	Loss: 35312.19922	PPL: 3.62456	bleu: 25.89675	LR: 0.00001211	
Steps: 312000	Loss: 35272.92188	PPL: 3.61937	bleu: 25.88367	LR: 0.00001211	*
Steps: 313000	Loss: 35299.66797	PPL: 3.62290	bleu: 25.95173	LR: 0.00001211	
Steps: 314000	Loss: 35297.89844	PPL: 3.62267	bleu: 25.83882	LR: 0.00001211	
Steps: 315000	Loss: 35298.33594	PPL: 3.62273	bleu: 25.91109	LR: 0.00001211	
Steps: 316000	Loss: 35268.37500	PPL: 3.61877	bleu: 25.95875	LR: 0.00001211	*
Steps: 317000	Loss: 35264.03125	PPL: 3.61820	bleu: 25.84213	LR: 0.00001211	*
Steps: 318000	Loss: 35263.61328	PPL: 3.61814	bleu: 25.87330	LR: 0.00001211	*
Steps: 319000	Loss: 35267.41406	PPL: 3.61864	bleu: 25.73969	LR: 0.00001211	
Steps: 320000	Loss: 35256.56250	PPL: 3.61721	bleu: 25.91235	LR: 0.00001211	*
Steps: 321000	Loss: 35270.18359	PPL: 3.61901	bleu: 25.97472	LR: 0.00001211	
Steps: 322000	Loss: 35244.44141	PPL: 3.61561	bleu: 25.78369	LR: 0.00001211	*
Steps: 323000	Loss: 35246.20312	PPL: 3.61585	bleu: 26.01238	LR: 0.00001211	
Steps: 324000	Loss: 35301.81641	PPL: 3.62319	bleu: 25.82574	LR: 0.00001211	
Steps: 325000	Loss: 35280.89062	PPL: 3.62042	bleu: 26.00126	LR: 0.00001211	
Steps: 326000	Loss: 35269.94922	PPL: 3.61898	bleu: 25.78010	LR: 0.00001211	
Steps: 327000	Loss: 35264.97656	PPL: 3.61832	bleu: 25.81127	LR: 0.00001211	
Steps: 328000	Loss: 35253.80078	PPL: 3.61685	bleu: 25.75368	LR: 0.00000847	
Steps: 329000	Loss: 35239.36328	PPL: 3.61494	bleu: 25.80209	LR: 0.00000847	*