File size: 144 Bytes
5fa1a76
 
 
1
2
3
position IDs
Contrary to RNNs that have the position of each token embedded within them, transformers are unaware of the position of
each token.