Remove 2017 Remove Clustering Remove Support Vector Machines
article thumbnail

From Rulesets to Transformers: A Journey Through the Evolution of SOTA in NLP

Mlearning.ai

The earlier models that were SOTA for NLP mainly fell under the traditional machine learning algorithms. These included the Support vector machine (SVM) based models. 2017) “ BERT: Pre-training of deep bidirectional transformers for language understanding ” by Devlin et al.