Download annotated papers (latest first)
| Model | Download annotated paper |
|---|---|
| Google DeepMind Gemini | Download paper (PDF). Available exclusively to full subscribers of The Memo. |
| Google Med-PaLM 2 | Download paper (PDF). Available exclusively to full subscribers of The Memo. |
| OpenAI GPT-4 | Download paper (PDF). Available exclusively to full subscribers of The Memo. |
Download report cards (latest first)
Designed in 2022, the LifeArchitect.ai report card provides a standard template for assessing new large language models and multimodal models.
| Model | Lab | Date | Grade/ALScore | Download |
|---|---|---|---|---|
| Gemini 1.5T | Google DeepMind | Dec/2023 | A- (22.4) | Gemini report card (PDF) |
| Llama 2 70B | Meta AI | Jul/2023 | B+ (1.2) | Llama 2 report card (PDF) |
| PaLM 2 340B | May/2023 | PX (3.7) | PaLM 2 report card (PDF) Updated to show poor performance on SuperGLUE=86.4% |
|
| GPT-4 1T | OpenAI | Mar/2023 | PX (14.9) | GPT-4 report card (PDF) |
| LLaMA-65B | Meta AI | Feb/2023 | B- (1.0) | LLaMA-65B report card (PDF) |
| Galactica 120B | Meta AI | Nov/2022 | B- (0.8) | GAL 120B report card (PDF) |
| AlexaTM 20B | Amazon Alexa AI | Aug/2022 | C (0.5) | Amazon AlexaTM 20B report card (PDF) |
| PaLM 540B | Jul/2022 | A (2.2) | Google PaLM report card (PDF) | |
| InstructGPT | OpenAI | Jul/2022 | B- (-) | OpenAI InstructGPT report card (PDF) |
Template
The report card template is open source, and available for download here.
Zoomed preview
Video
Get The Memo
by Dr Alan D. Thompson · Be inside the lightning-fast AI revolution.Informs research at Apple, Google, Microsoft · Bestseller in 147 countries.
Artificial intelligence that matters, as it happens, in plain English.
Get The Memo.
Alan D. Thompson is a world expert in artificial intelligence, advising everyone from Apple to the US Government on integrated AI. Throughout Mensa International’s history, both Isaac Asimov and Alan held leadership roles, each exploring the frontier between human and artificial minds. His landmark analysis of post-2020 AI—from his widely-cited Models Table to his regular intelligence briefing The Memo—has shaped how governments and Fortune 500s approach artificial intelligence. With popular tools like the Declaration on AI Consciousness, and the ASI checklist, Alan continues to illuminate humanity’s AI evolution. Technical highlights.This page last updated: 7/Feb/2024. https://lifearchitect.ai/report-card/↑