As of 18/Jan/2023, GPT-4 has not yet been announced. This page will be updated as news comes...
GPT-4 report card[Coming soon…]
GPT-4 size and stats[Coming soon…]
See: What’s in my AI for coverage of datasets from the latest models like DeepMind Chinchilla (the MassiveText dataset, also used in Gopher), and GPT-3.[Coming soon…]
GPT-4 capabilities[Coming soon…]
A visualization of the capabilities of PaLM 8B to PaLM 540B, by Google AI (4/Apr/2022):
GPT-4 datacenter location
GPT-3 talks about GPT-4…
“From talking to OpenAI, GPT-4 will be about 100 trillion parameters…”
— Cerebras in Wired (24/Aug/2021)
At 100T parameters, GPT-4 would be over 500 times larger than GPT-3. That means GPT-4 would have roughly the same number of parameters (connections) as there are synapses (connections between neurons) in the human brain. (It is estimated that the human brain has 125T synapses connecting 86B neurons.)
A more realistic prediction of GPT-4 size is explored in this video (Jul/2022):
Robert Scoble (‘A friend has access to GPT-4 and can’t talk about it due to NDAs. Was about to tell me everything about it and then remembered who he was talking to. His emotion alone told me it is next level.’)
A friend has access to GPT-4 and can’t talk about it due to NDAs. Was about to tell me everything about it and then remembered who he was talking to.
His emotion alone told me it is next level. https://t.co/Ard1gpRxau
— Robert Scoble (@Scobleizer) August 20, 2022
Via a reddit thread Nov/2022. https://thealgorithmicbridge.substack.com/p/gpt-4-rumors-from-silicon-valley
I'm using GPT-4 to draft a blog post for a startup I'm working with and holy sh!t 🤯 absolute game changer
— Jack Randall (@JackRandalll) November 16, 2022
GPT3: 175b params for $4.6M. GPT4: 100t params for $2.6B. This trend line can't go up much further. After that we'll have to wait for computing cost to fall. https://t.co/6R2rOFfx9g
— Robin Hanson (@robinhanson) December 12, 2022
@sama said OpenAI’s GPT-4 will launch only when they can do it safely & responsibly. “In general we are going to release technology much more slowly than people would like. We're going to sit on it for much longer…” Also confirmed video model in the works in convo w/ @Cookie pic.twitter.com/Y0XHHvcqNw
— Krystal Hu (@readkrystalhu) January 13, 2023
During an interview with StrictlyVC, Altman was asked if GPT-4 will come out in the first quarter or half of the year, as many expect. He responded by offering no certain timeframe. “It’ll come out at some point, when we are confident we can do it safely and responsibly,” he said.
When asked about one viral (and factually incorrect) chart that purportedly compares the number of parameters in GPT-3 (175 billion) to GPT-4 (100 trillion), Altman called it “complete bullshit.”
“The GPT-4 rumor mill is a ridiculous thing. I don’t know where it all comes from,” said the OpenAI CEO. “People are begging to be disappointed and they will be. The hype is just like… We don’t have an actual AGI and that’s sort of what’s expected of us.” – via The Verge (18/Jan/2023)
Dr Alan D. Thompson is an AI expert and consultant, advising Fortune 500s and governments on post-2020 large language models. His work on artificial intelligence has been featured at NYU, with Microsoft AI and Google AI teams, at the University of Oxford’s 2021 debate on AI Ethics, and in the Leta AI (GPT-3) experiments viewed more than 2.5 million times. A contributor to the fields of human intelligence and peak performance, he has held positions as chairman for Mensa International, consultant to GE and Warner Bros, and memberships with the IEEE and IET. He is open to consulting and advisory on major AI projects with intergovernmental organizations and enterprise.
This page last updated: 19/Jan/2023. https://lifearchitect.ai/gpt-4/↑