“From talking to OpenAI, GPT-4 will be about 100 trillion parameters…”
— Cerebras in Wired (24/Aug/2021)
At 100T parameters, GPT-4 will be over 500 times larger than GPT-3.
GPT-4 will also have roughly the same number of parameters (connections) as there are synapses (connections between neurons) in the human brain. (It is estimated that the human brain has 125T synapses connecting 86B neurons.)
See also:
- My GPT-4 size prediction at 10T (July 2021).
- Timeline of AI releases including GPT-2, GPT-3, GPT-4.
- AI + the human brain (July 2021).
- Conversations with Leta, GPT-3 AI (YouTube).
Get The Memo
by Dr Alan D. Thompson · Hundreds of paid subscribersBe inside the lightning-fast AI revolution.
Artificial intelligence that matters, as it happens, in plain English.
Get The Memo.
⬛
Dr Alan D. Thompson is an AI expert and consultant. With Leta (an AI powered by GPT-3), Alan co-presented a seminar called ‘The new irrelevance of intelligence’ at the World Gifted Conference in August 2021. His applied AI research and visualisations are featured across major international media, including citations in the University of Oxford’s debate on AI Ethics in December 2021. He has held positions as chairman for Mensa International, consultant to GE and Warner Bros, and memberships with the IEEE and IET. He is open to consulting and advisory on major AI projects with intergovernmental organisations and enterprise. Contact.
This page last updated: 26/Aug/2021. https://lifearchitect.ai/gpt-4/↑
