README.md

metadata

thumbnail: >-
  https://github.com/SauravMaheshkar/CommonLit-Readibility/blob/main/assets/CommonLit%20-%20Big%20Banner.png?raw=true
tags:
  - kaggle
license: cc0-1.0
datasets:
  - Commonlit-Readibility
metrics:
  - Perplexity

PreTraining

Architecture	Weights	PreTraining Loss	PreTraining Perplexity
roberta-base	huggingface/hub	0.3488	3.992
bert-base-uncased	huggingface/hub	0.3909	6.122
electra-large	huggingface/hub	0.723	6.394
albert-base	huggingface/hub	0.7343	7.76
electra-small	huggingface/hub	0.9226	11.098
electra-base	huggingface/hub	0.9468	8.783
distilbert-base-uncased	huggingface/hub	1.082	7.963