Masked Language Learning

It is a process where we need to predict the word that has been masked (blank), in this scenario the context of the missing word is crucial and this is where the Bi-Directional feature of encoders shine in identifying the word in the sequence of words