DeepPavlov models in HuggingFace are uploaded without MLM head
Created by: yurakuratov
MLM head (and NSP head?) are not in BERT checkpoint that were uploaded to https://huggingface.co/DeepPavlov Issue in Transformers repo: https://github.com/huggingface/transformers/issues/5806
discussion in ODS: https://opendatascience.slack.com/archives/C04N3UMSL/p1586900942057100