NLP's ImageNet moment has arrived

Big changes are underway in the world of Natural Language Processing (NLP). The long reign of word vectors as NLP’s core representation technique has seen an exciting new line of challengers emerge: ELMo[1], ULMFiT[2], and the OpenAI transformer[3]. These works made headlines by demonstrating that pretrained language models can be used to achieve state-of-the-art results on a wide range of NLP tas

[yoshikidz]

おもろい。抽象化するとまあそうだけど、根本的なものがどんどん欠落していくな。神parserができないとやってていつも限界見えちゃう