RoBERTa - Optimized BERT Pretraining Approach July 26, 2019 • 5 min read Unlocking the true potential of BERT through rigorous optimization and strategic training choices