For the past two years, the “transformer” architecture has achieved state-of-the-art performance on most benchmark NLP tasks. A transformer model considers the entire input sequence of text at once - rather than one word or character at a time - a...

When machine learning models are trained to perform a particular task, we usually collect a set of samples, the “test set”, that is representative of the task at hand in order to measure the model’s performance. If there are any limitations on th...