As of 24/Nov/2022, GPT-4 has not yet been announced. This page will be updated as news comes...
GPT-4 report card[Coming soon…]
GPT-4 size and stats[Coming soon…]
See: What’s in my AI for coverage of datasets from the latest models like DeepMind Chinchilla (the MassiveText dataset, also used in Gopher), and GPT-3.[Coming soon…]
GPT-4 capabilities[Coming soon…]
A visualization of the capabilities of PaLM 8B to PaLM 540B, by Google AI (4/Apr/2022):
GPT-4 datacenter location
GPT-3 talks about GPT-4…
“From talking to OpenAI, GPT-4 will be about 100 trillion parameters…”
— Cerebras in Wired (24/Aug/2021)
At 100T parameters, GPT-4 would be over 500 times larger than GPT-3. That means GPT-4 would have roughly the same number of parameters (connections) as there are synapses (connections between neurons) in the human brain. (It is estimated that the human brain has 125T synapses connecting 86B neurons.)
A more realistic prediction of GPT-4 size is explored in this video (Jul/2022):
Robert Scoble (‘A friend has access to GPT-4 and can’t talk about it due to NDAs. Was about to tell me everything about it and then remembered who he was talking to. His emotion alone told me it is next level.’)
A friend has access to GPT-4 and can’t talk about it due to NDAs. Was about to tell me everything about it and then remembered who he was talking to.
His emotion alone told me it is next level. https://t.co/Ard1gpRxau
— Robert Scoble (@Scobleizer) August 20, 2022
Via a reddit thread Nov/2022. https://thealgorithmicbridge.substack.com/p/gpt-4-rumors-from-silicon-valley
I'm using GPT-4 to draft a blog post for a startup I'm working with and holy sh!t 🤯 absolute game changer
— Jack Randall (@JackRandalll) November 16, 2022
Dr Alan D. Thompson is an AI expert and consultant, advising Fortune 500s and governments on post-2020 large language models. His work on artificial intelligence has been featured at NYU, with Microsoft AI and Google AI teams, at the University of Oxford’s 2021 debate on AI Ethics, and in the Leta AI (GPT-3) experiments viewed more than 2.5 million times. A contributor to the fields of human intelligence and peak performance, he has held positions as chairman for Mensa International, consultant to GE and Warner Bros, and memberships with the IEEE and IET. He is open to consulting and advisory on major AI projects with intergovernmental organizations and enterprise.
This page last updated: 24/Nov/2022. https://lifearchitect.ai/gpt-4/↑