Language model sizes Summary of current models Count of LLMs released per month (2024) Compute Context windows Achievements unlocked: Emergent abilities of LLMs Large language models: API or on-premise Increasing dataset sizes 2018-2023 GPT-3’s top 10 datasets by domain/source Contents of GPT-3 & the Pile v1 Contents of Chinese models Language model sizes & predictions … Continue reading Inside language models (from GPT to Olympus)