At the time, most language models scored little better than 25% on MMLU, which is what you would get by picking answers at random; Open AI ’s GPT -3 did best, with a score of 43.9%.