Timeline of AI and language models

Download source (PDF)

Time between releases of OpenAI’s GPT models

Model Months since last release
GPT-4
June/2022?
25m?
 25 months?
GPT-3
May/2020
15m
 15 months
GPT-2
Feb/2019
8m
 8 months
GPT-1
Jun/2018		 Baseline

Full AI timeline

Showing selected major milestones in AI development. Yes, the timeline is ordered by year descending, then month ascending, for my own amusement.

Next…

TBA

GPT-4 (model)

OpenAI

TBA

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2021

January

The Pile v1 (dataset)

EleutherAI

Read the EleutherAI blog

March

Wudao 1.0 (model)

BAAI

Read the paper

June

GPT-J-6B (model)

EleutherAI

See the GitHub repo

June

LaMDA 137B (chatbot model)

Google

Read the Google blog

June

Wudao 2.0 (model)

BAAI

Read the paper

June

M6 1T – MultiModality-to-MultiModality Multitask Mega-transformer (model)

Alibaba Dharma Academy

Read the release (Chinese)

July

BlenderBot 2.0 (chatbot model)

Facebook

Read the paper

August

Jurassic-1 178B (model)

AI21

Read the paper

September

PLATO-XL 11B (chatbot model)

Baidu

Read more about PLATO-XL

September

Macaw 11B (Q&A model)

AI2 (Allen AI)

Read the paper

October

Megatron-Turing NLG 530B (model)

NVIDIA + Microsoft

Read more about Megatron

October

Yuan 1.0 245B (model)

Inspur AI (China)

Read the paper

November

M6 10T – MultiModality-to-MultiModality Multitask Mega-transformer (model)

Alibaba Dharma Academy

Read the release (Chinese)

November

Cedille 6B (model)

Cedille (French model based on GPT-J 6B)

Read the release

 

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2020

January

Meena (chatbot model)

Google

Read the Google blog

April

BlenderBot 1.0 (chatbot model)

Facebook

Read the Facebook blog

May

GPT-3 175B (model)

OpenAI

Read the paper

September

GPT-3 writes a newspaper column

The Guardian/OpenAI

Read the article

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2019

February

GPT-2 1.5B (model)

OpenAI

Read the paper

October

BERT used for search

Google

Read the Google blog

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2018

June

GPT-1 (model)

OpenAI

Read the paper

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2017

August

Transformer (architecture)

Google

Read the Google blog

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2011

February

Watson (system)

IBM

Appeared on Jeopardy! against champions Brad Rutter and Ken Jennings, winning the first place prize of $1m

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

1966

ELIZA (chatbot)

MIT

Read the Wiki article

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

1950

Turing test (paper)

Read the paper

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

1947

Turing lecture

First public lecture (London, 1947) to mention computer intelligence. Turing said: ‘What we want is a machine that can learn from experience… the possibility of letting the machine alter its own instructions provides the mechanism for this.’ A few months later, he introduced many of the central concepts of AI in an unpublished paper: Intelligent Machinery. Britannica

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]
⬛
Dr Alan D. Thompson is an AI expert and consultant. With Leta (an AI powered by GPT-3), Alan co-presented a seminar called ‘The new irrelevance of intelligence’ at the World Gifted Conference in August 2021. He has held positions as chairman for Mensa International, consultant to GE and Warner Bros, and memberships with the IEEE and IET. He is open to major AI projects with intergovernmental organisations and impactful companies, and is currently based in the US through 2022. Contact.

This page last updated: 19/Nov/2021. https://lifearchitect.ai/timeline/↑

Related articles by Life Architect...