As of 18/Jan/2023, GPT-4 has not yet been announced. This page will be updated as news comes...

GPT-4 report card

[Coming soon…]

Zoomed preview

Download source (PDF) [Coming soon…]

GPT-4 size and stats

[Coming soon…]

Download source (PDF) [Coming soon…]

GPT-4 dataset

See: What’s in my AI for coverage of datasets from the latest models like DeepMind Chinchilla (the MassiveText dataset, also used in Gopher), and GPT-3.

[Coming soon…]

GPT-4 capabilities

[Coming soon…]

A visualization of the capabilities of PaLM 8B to PaLM 540B, by Google AI (4/Apr/2022):

GPT-4 datacenter location

GPT-4 rumors

GPT-3 talks about GPT-4…

“From talking to OpenAI, GPT-4 will be about 100 trillion parameters…”
— Cerebras in Wired (24/Aug/2021)

At 100T parameters, GPT-4 would be over 500 times larger than GPT-3. That means GPT-4 would have roughly the same number of parameters (connections) as there are synapses (connections between neurons) in the human brain. (It is estimated that the human brain has 125T synapses connecting 86B neurons.)

A more realistic prediction of GPT-4 size is explored in this video (Jul/2022):

Update 21/Aug/2022:
Robert Scoble (‘A friend has access to GPT-4 and can’t talk about it due to NDAs. Was about to tell me everything about it and then remembered who he was talking to. His emotion alone told me it is next level.’)

Update 12/Nov/2022:

Via a reddit thread Nov/2022.

Update 17/Nov/2022:

Update 13/Dec/2022:

Update 17/Jan/2023:

Update 18/Jan/2023:

During an interview with StrictlyVC, Altman was asked if GPT-4 will come out in the first quarter or half of the year, as many expect. He responded by offering no certain timeframe. “It’ll come out at some point, when we are confident we can do it safely and responsibly,” he said.

When asked about one viral (and factually incorrect) chart that purportedly compares the number of parameters in GPT-3 (175 billion) to GPT-4 (100 trillion), Altman called it “complete bullshit.”

“The GPT-4 rumor mill is a ridiculous thing. I don’t know where it all comes from,” said the OpenAI CEO. “People are begging to be disappointed and they will be. The hype is just like… We don’t have an actual AGI and that’s sort of what’s expected of us.” – via The Verge (18/Jan/2023)

Get The Memo

by Dr Alan D. Thompson · Be inside the lightning-fast AI revolution.
Thousands of paid subscribers. Readers from Microsoft, Tesla, Google AI...
Artificial intelligence that matters, as it happens, in plain English.
Get The Memo.

Dr Alan D. Thompson is an AI expert and consultant, advising Fortune 500s and governments on post-2020 large language models. His work on artificial intelligence has been featured at NYU, with Microsoft AI and Google AI teams, at the University of Oxford’s 2021 debate on AI Ethics, and in the Leta AI (GPT-3) experiments viewed more than 2.5 million times. A contributor to the fields of human intelligence and peak performance, he has held positions as chairman for Mensa International, consultant to GE and Warner Bros, and memberships with the IEEE and IET. He is open to consulting and advisory on major AI projects with intergovernmental organizations and enterprise.

This page last updated: 19/Jan/2023.