Alan D. Thompson
24 pages incl title page, references, appendices.
Updates to the Pathways family since publication
2. 15/Sep/2022: PaLI: Google Pathways Language and Image model: paper.
Received by at least one major Western government; used in policy analysis.
With over a million subscribed users, GPT-3 and related models have received a lot of press coverage and public attention. Much like a flashy Porsche driving down the Autobahn, these models look impressive, and are performing well. However, it is only a matter of time until they are overtaken by a much larger supercar. And that vehicle is already rapidly approaching. Google Pathways was announced at the end of 2021, and we are seeing several of its components in 2022: beginning with PaLM, PaLM-Coder, Parti, and Minerva. While all of these models are closed—only available for Google’s internal research—it is anticipated that a future Pathways model will be publicly released. This report explores the accomplishments of the Pathways models so far, with PaLM and its related language models already at more than triple the size of GPT-3.
1. Google Pathways (Oct/2021)
2. Google Pathways: The Pathways System (Mar/2022)
3. Google Pathways: PaLM 540B (Apr/2022)
3.1. PaLM Dataset Summary
3.2. PaLM Capabilities & Performance
4. Google Pathways: PaLM-Coder 540B (Apr/2022)
5. Google Pathways: Parti 20B (Jun/2022)
6. Google Pathways: Minerva 540B (Jun/2022)
6.1. The Polish National Math Exam
7. Following the Trail to Transformative AI
8. Further reading
Appendix A: PaLM 540B vs GPT-3 175B vs Jurassic-1 178B vs human
Image credit: Thanks to jesssaysno for the header image on this page.
Dr Alan D. Thompson is an AI expert and consultant. With Leta (an AI powered by GPT-3), Alan co-presented a seminar called ‘The new irrelevance of intelligence’ at the World Gifted Conference in August 2021. His applied AI research and visualisations are featured across major international media, including citations in the University of Oxford’s debate on AI Ethics in December 2021. He has held positions as chairman for Mensa International, consultant to GE and Warner Bros, and memberships with the IEEE and IET. He is open to consulting and advisory on major AI projects with intergovernmental organisations and enterprise.
This page last updated: 15/Sep/2022. https://lifearchitect.ai/pathways/↑