Language model sizes Summary of current models Compute Context windows Achievements unlocked: Emergent abilities of LLMs Large language models: API or on-premise Increasing dataset sizes 2018-2023 GPT-3’s top 10 datasets by domain/source Contents of GPT-3 & the Pile v1 Contents of Chinese models Language model sizes & predictions Facebook BlenderBot 2.0 datasets by domain/source Facts … Continue reading Inside language models (from GPT to Olympus)