Grok

Advising organizations from Apple to the US Gov, & cited in the new G7 AI doc.†
Get The Memo.

Summary

Organization xAI
Model name Grok-0 33B (Aug/2023)
Grok-1 314B MoE (Nov/2023)
Grok-1.5 (Mar/2024)
Grok-2 (Aug/2024)
Grok-3 (Feb/2025)
Internal/project name TruthGPT
Model type Multimodal (text, vision)
Parameter count See What’s in Grok?
Dataset size (tokens) See What’s in Grok?
Training time (total) See working, with sources.
Release date (public) 2023–2025
Announce https://x.ai/blog/grok-3
Playground https://x.com/i/grok

Grok Updates

ALPrompt scores (base model/non-reasoning):
2024H1=5/5
2024H2=2/5 (4/5 with reasoning)
2025H1=1/5. First frontier model to consistently admit that it doesn’t know the answer to something.

GPQA Grok-3=75.4%, Grok-3 + reasoning + ITC=84.6%
MMLU-Pro Grok-3=79.9%

Screenshots:

13/Feb/2025: xAI CEO: ‘Grok 3 has very powerful reasoning capabilities, so in the tests that we’ve done thus far, Grok 3 is outperforming anything that’s been released, that we’re aware of, so that’s a good sign’ (Reuters, 13/Feb/2025)

9/Feb/2025: On Chatbot Arena (formerly LMSYS), ‘Chocolate’ model (said to be Grok-3) performs very poorly. For ALPrompt2024H2, GPT-4o=4/5. Chocolate=1/5. 

8/Dec/2024: xAI developer Chris Park: ‘Grok 2 + Aurora [xAI’s own image generator] is now available with your X app in the model selector. Oh, by the way, Grok 3 is coming.’

Older updates...

29/Oct/2024: ‘Inside the World’s Largest AI Supercluster xAI Colossus’ (link)

21/Sep/2024: Elon: ‘Grok 3 is training with 10X, soon 20X the compute of Grok 2’ (Twitter)

14/Aug/2024: Grok-2 achieves MMLU-Pro=75.5=SOTA. Claude 3.5S MMLU-Pro=72.83.

Aug/2024: “Grok-2 has been tested on the LMSYS leaderboard under the name “sus-column-r.” At the time of this blog post, it is outperforming both Claude 3.5 Sonnet and GPT-4-Turbo.” [Alan: Grok is by Heinlein, Sixth Column is also by Heinlein: https://en.wikipedia.org/wiki/Sixth_Column]

22/Jul/2024: 100,000 H100s. “xAI team, X team, Nvidia & supporting companies getting Memphis Supercluster training started at ~4:20am local time [today, 22/Jul/2024]. With 100k liquid-cooled H100s on a single RDMA fabric, it’s the most powerful AI training cluster in the world!” & “training the world’s most powerful AI [Grok-3] by every metric by December this year [2024]” (Tweet)

22/Mar/2023: ‘Pause AI training so xAI can catch up!’ Letter signed by xAI founder and CEO: “we call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4. This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in and institute a moratorium.” (FILI)

11/Mar/2023: xAI founded with 12 founding members + Musk:

  1. Igor Babuschkin: ex-DeepMind, OpenAI, CERN.
  2. Manuel Kroiss: ex-DeepMind, Google.
  3. Dr Yuhuai (Tony) Wu: ex-Google, Stanford, University of Toronto, ex-intern at DeepMind, OpenAI.
  4. Dr Christian Szegedy: ex-Google (over a decade).
  5. Prof Jimmy Ba: ex-University of Toronto, advised by Prof Geoffrey Hinton.
  6. Toby Pohlen: ex-Google, Microsoft.
  7. Ross Nordeen: ex-Tesla AI.
  8. Kyle Kosic: ex-OpenAI, OnScale, Wells Fargo.
  9. Greg Yang: ex-Microsoft Research, Harvard.
  10. Dr Guodong Zhang: ex-DeepMind, ex-intern Google Brain, Microsoft Research.
  11. Dr Zihang Dai: ex-Google, Tsinghua.
  12. Dr Dan Hendrycks (advisor): UC Berkeley, Center for AI Safety, ex-intern DeepMind

(— The Memo 17/Jul/2023)

Dataset

A Comprehensive Analysis of xAI’s Grok models

Alan D. Thompson
LifeArchitect.ai
January 2025
30+ pages incl title page, references, appendices.

View the report

Timeline to Grok

Date Milestone
9/Mar/2023 xAI founded.
22/Mar/2023 xAI founder and CEO disingenuously calls for pause on training all AI frontier models worldwide.
18/Aug/2023 (Five months after pause letter…)
Grok-0 33B announced.
3/Nov/2023 (Seven months after pause letter…)
Grok-1 314B announced.
7/Dec/2023 Grok-1 available on X.
17/Mar/2024 Grok-1 314B released on GitHub.
28/Mar/2024 Grok-1.5 announced.
12/Apr/2024 Grok-1.5V announced.
5/May/2024 Grok-1.5 available on X.
13/Aug/2024 Grok-2 released.
Feb/2025 Grok-3 announced.

Get The Memo

by Dr Alan D. Thompson · Be inside the lightning-fast AI revolution.
Informs research at Apple, Google, Microsoft · Bestseller in 147 countries.
Artificial intelligence that matters, as it happens, in plain English.
Get The Memo.

Alan D. Thompson is a world expert in artificial intelligence, advising everyone from Apple to the US Government on integrated AI. Throughout Mensa International’s history, both Isaac Asimov and Alan held leadership roles, each exploring the frontier between human and artificial minds. His landmark analysis of post-2020 AI—from his widely-cited Models Table to his regular intelligence briefing The Memo—has shaped how governments and Fortune 500s approach artificial intelligence. With popular tools like the Declaration on AI Consciousness, and the ASI checklist, Alan continues to illuminate humanity’s AI evolution. Technical highlights.

This page last updated: 9/Mar/2025. https://lifearchitect.ai/grok/↑