Timeline of AI and language models

Next

Showing major highlights of language and multimodal models only (less focus on text-to-image generation models). Showing Western models mostly (less focus on China, South Korea). Showing selected major milestones in AI development. The timeline is now ordered chronologically.

See a more comprehensive view of all model highlights in the Models Table.

1947

Turing lecture

First public lecture (London, 1947) to mention computer intelligence. Turing said: ‘What we want is a machine that can learn from experience… the possibility of letting the machine alter its own instructions provides the mechanism for this.’ A few months later, he introduced many of the central concepts of AI in an unpublished paper: Intelligent Machinery. Britannica

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

1950

Turing test (paper)

Read the paper

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

1956

‘Artificial intelligence’ coined by Minsky et al

Read the article by Dartmouth, USA

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

1966

ELIZA (chatbot)

MIT

Read the Wiki article

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2011

February

Watson (system)

IBM

Appeared on Jeopardy! against champions Brad Rutter and Ken Jennings, winning the first place prize of $1m. 

Read my comparison with GPT-3.

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2017

August

Transformer (architecture)

Google

Read the Google blog

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2018

January

ULMFit 34M (model)

fast.ai

Read the paper

June

GPT-1 117M (model)

OpenAI

Read the paper

October

BERT 340M (model)

Google

Read the paper

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2019

February

GPT-2 1.5B (model)

OpenAI

Read the paper

October

BERT used for search

Google

Read the Google blog

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2020

January

Meena 2.6B (chatbot model)

Google

Read the Google blog

April

BlenderBot 1.0 (chatbot model)

Facebook

Read the Facebook blog

May

GPT-3 175B (model)

OpenAI

Read the paper
Alan’s report

September

GPT-3 writes a newspaper column

The Guardian/OpenAI

Read the article

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2021

January

The Pile v1 (dataset)

EleutherAI

Read the EleutherAI blog

March

Wudao 1.0 (model)

BAAI

Read the paper

June

GPT-J-6B (model)

EleutherAI

See the GitHub repo

June

LaMDA 137B (chatbot model)

Google

Read the Google blog
Alan’s report

June

Wudao 2.0 (model)

BAAI

Read the paper

June

M6 1T – MultiModality-to-MultiModality Multitask Mega-transformer (sparse model)

Alibaba Dharma Academy

Read the release (Chinese)

August

Jurassic-1 178B (model)

AI21

Read the paper

October

Megatron-Turing NLG 530B (model)

NVIDIA + Microsoft

Read more about Megatron
Alan’s report

November

M6 10T – MultiModality-to-MultiModality Multitask Mega-transformer (sparse model)

Alibaba Dharma Academy

Read the release (Chinese)

November

BERT 480B & 200B (model)

Google

Read the release, 2

December

52B (model)

Anthropic

Read the paper

December

GLaM 1.1T (model)

Google inc

Read the Google blog

December

Gopher 280B (model)

Google AI

Read the paper

December

ERNIE 3.0 Titan 260B (model)

Baidu

Read the paper

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2022

March

Chinchilla 70B (model)

DeepMind

Read the paper
Alan’s report

March

BLOOM – tr11-176B-ml (model)

BigScience

See the repo

April

PaLM 540B (model)

Google Inc

Read the Google blog
Alan’s report

April

Flamingo (Chinchilla 70B + 10B visual model)

DeepMind

Read the blog + paper

May

OPT-175B (model)

Meta AI

Read the paper

May

LaMDA 2 137B (chatbot model)

Google AI

Watch the launch video

May

Gato (Cat) 1.18B (general model)

DeepMind

Read the paper

November

GPT-3.5 – text-davinci-003 (model)

OpenAI

Read my overview

November

ChatGPT (model)

OpenAI

Read the blog
Alan’s report

December

RT-1 35M (general model)

Google

Read the paper

December

RL-CAI 52B (model)

Anthropic

Read the paper

December

OPT-IML 175B (model)

Meta AI

Read the paper

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2023

February

LLaMA-65B (model)

Meta AI

Read the paper

March

Alpaca 7B (model)

Stanford

Read the release

March

GPT-4 1.76T (model)

OpenAI

Read the paper, 
Alan’s report

May

PaLM 2 340B (model)

Google

Read the paper

June

phi-1 1.3B (model)

Microsoft

Read the paper

June

Inflection-1 (model)

Inflection AI

Read the paper

July

Claude 2 (model)

Anthropic

Read the announce

July

Llama 2 70B (model)

Meta AI

Read the paper

September

Falcon 180B (model)

TII

Read the announce

October

ERNIE 4.0 (model)

Baidu

Read the announce.
Read Alan’s notes.

November

Grok-1 314B (model)

xAI

Read the announce (archive)

December

Gemini (model)

Google DeepMind

Read the technical report.
Read Alan’s report.

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

2024

February

Sora (world model)

OpenAI

Read the technical report

February

Gemini 1.5 (model)

Google DeepMind

Read the paper (PDF)

March

Claude 3 Opus (model)

Anthropic

Read the paper (PDF)

April

Llama 3 70B (model)

Meta AI

Read the announce

April

phi-3 14B (model)

Microsoft

Read the paper

June

Nemotron-4-340B (model)

NVIDIA

Read the paper

June

Claude 3.5 Sonnet (model)

Anthropic

Read the announce

July

Llama 3.1 405B (model)

Meta AI

Read the announce

August

Grok-2 (model)

xAI

Read the announce

September

o1 (model)

OpenAI

Read the announce

October

Claude with computer use (model)

Anthropic

Read the announce

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

Next…

TBA

Olympus 2T+ (model)

Amazon

Read more,
Alan’s report

[bold_timeline_item_button title=”Expand” style=”” shape=”” color=”” size=”inline” url=”#” el_class=”bold_timeline_group_button”]

Models Table

Summary of current models: View the full data (Google sheets)

Show older timeline slides

Download source (PDF)

Time between releases of OpenAI’s GPT models

Model Months since last release
GPT-4
Mar/2023
14m
 14 months
GPT-3 2022 text-davinci-002
Jan/2022
20m
 20 months
GPT-3
May/2020
15m
 15 months
GPT-2
Feb/2019
8m
 8 months
GPT-1
Jun/2018		 Baseline

Get The Memo

by Dr Alan D. Thompson · Be inside the lightning-fast AI revolution.
Bestseller. 10,000+ readers from 142 countries. Microsoft, Tesla, Google...
Artificial intelligence that matters, as it happens, in plain English.
Get The Memo.

Dr Alan D. Thompson is an AI expert and consultant, advising Fortune 500s and governments on post-2020 large language models. His work on artificial intelligence has been featured at NYU, with Microsoft AI and Google AI teams, at the University of Oxford’s 2021 debate on AI Ethics, and in the Leta AI (GPT-3) experiments viewed more than 4.5 million times. A contributor to the fields of human intelligence and peak performance, he has held positions as chairman for Mensa International, consultant to GE and Warner Bros, and memberships with the IEEE and IET. Technical highlights.

This page last updated: 14/Aug/2024. https://lifearchitect.ai/timeline/↑