Language model sizes Summary of current models Velocity of LLMs released per month (2026) Count of LLMs released per month (2024) Compute Context windows Achievements unlocked: Emergent abilities of LLMs Large language models: API or on-premise Increasing dataset sizes 2018-2025 GPT-3’s top 10 datasets by domain/source Contents of GPT-3 & the Pile v1 Contents of … Continue reading Inside language models (2020–2026 archive)