Pre-trained to have better reasoning ability, try this if you are working with task like QA. For more details please see https://openreview.net/forum?id=cGB7CMFtrSx

This is based on tapas-base(no_reset) model and pre-trained for table input