File size: 198 Bytes
5fa1a76
 
 
 
1
2
3
4
Natural language processing

Encoder[[nlp-encoder]]
BERT is an encoder-only Transformer that randomly masks certain tokens in the input to avoid seeing other tokens, which would allow it to "cheat".