Grok

xAI doesn't need to wait until Monday. This team is too cracked and stays shipping.

Congrats @xai for releasing a brand new image gen model —Aurora!

Grok 2 + Aurora is now available with your X app in the model selector.

Oh, by the way, Grok 3 is coming. 🚀 https://t.co/l92HwU4q9e

— Chris Park (@chrisparkX) December 7, 2024

xAI’s own?

— Edson Barlow (@eddib17_) December 7, 2024

29/Oct/2024: ‘Inside the World’s Largest AI Supercluster xAI Colossus’ (link)

21/Sep/2024: Elon: ‘Grok 3 is training with 10X, soon 20X the compute of Grok 2’ (Twitter)

14/Aug/2024: Grok-2 achieves MMLU-Pro=75.5=SOTA. Claude 3.5S MMLU-Pro=72.83.

Aug/2024: “Grok-2 has been tested on the LMSYS leaderboard under the name “sus-column-r.” At the time of this blog post, it is outperforming both Claude 3.5 Sonnet and GPT-4-Turbo.” [Alan: Grok is by Heinlein, Sixth Column is also by Heinlein: https://en.wikipedia.org/wiki/Sixth_Column]

22/Jul/2024: 100,000 H100s. “xAI team, X team, Nvidia & supporting companies getting Memphis Supercluster training started at ~4:20am local time [today, 22/Jul/2024]. With 100k liquid-cooled H100s on a single RDMA fabric, it’s the most powerful AI training cluster in the world!” & “training the world’s most powerful AI [Grok-3] by every metric by December this year [2024]” (Tweet)

22/Mar/2023: ‘Pause AI training so xAI can catch up!’ Letter signed by xAI founder and CEO: “we call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4. This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in and institute a moratorium.” (FILI)

11/Mar/2023: xAI founded with 12 founding members + Musk:

1. Igor Babuschkin: ex-DeepMind, OpenAI, CERN.
2. Manuel Kroiss: ex-DeepMind, Google.
3. Dr Yuhuai (Tony) Wu: ex-Google, Stanford, University of Toronto, ex-intern at DeepMind, OpenAI.
4. Dr Christian Szegedy: ex-Google (over a decade).
5. Prof Jimmy Ba: ex-University of Toronto, advised by Prof Geoffrey Hinton.
6. Toby Pohlen: ex-Google, Microsoft.
7. Ross Nordeen: ex-Tesla AI.
8. Kyle Kosic: ex-OpenAI, OnScale, Wells Fargo.
9. Greg Yang: ex-Microsoft Research, Harvard.
10. Dr Guodong Zhang: ex-DeepMind, ex-intern Google Brain, Microsoft Research.
11. Dr Zihang Dai: ex-Google, Tsinghua.
12. Dr Dan Hendrycks (advisor): UC Berkeley, Center for AI Safety, ex-intern DeepMind

(— The Memo 17/Jul/2023)