license: mit
This is a encoder only Tranformer model with 43 Million parameters It was trained on around 4 Million tokens
