AI in 2018
3 events, oldest first. Each links to a page with details and sources.
- OpenAI's GPT-1: generative pre-training of Transformers ★★★★
OpenAI showed that pre-training a Transformer language model on unlabeled text and then fine-tuning it yields strong results across many NLP tasks — the first 'GPT'.
- Google releases BERT, bidirectional Transformer pre-training ★★★★
BERT pre-trained a bidirectional Transformer encoder with masked language modeling and set new records on 11 NLP tasks; it was open-sourced and soon deployed in Google Search.
- AlphaFold (v1) tops the CASP13 protein-structure prediction assessment ★★★★
DeepMind's first AlphaFold ranked first in the CASP13 blind assessment of protein structure prediction, an early sign that deep learning could crack the protein folding problem.