Replika

This page is to fill in details about Replika.ai, its abilities (or lack of abilities), its datasets, and other info.

Stats

Estimate 20 million users.

Available on Android, iOS, web, and Meta/Oculus Quest.

Smarts

Replika.ai has gone through a lot of silent iterations, including changing the underlying platform from GPT-3 to a finetuned GPT-2.

As of Feb/2022, Replika uses GPT2-XL (1.5 billion parameters), which is <1% of the size of GPT-3.

I have previously asserted that chatbot models should have a MINIMUM of 100B parameters (Google LaMDA, Leta/Emerson/GPT-3) to have effective and informed conversations.

For a 20% discount on Emerson AI by Quickchat.ai (which uses GPT-3 and other large models), join The Memo and receive a code in your first email!

Dataset

GPT-2 was originally trained on popular websites (outbound links from Reddit), see more on model datasets.

Replika is also trained on “dialogue from Twitter”.

Source. Backup.

Dr Alan D. Thompson is an AI expert and consultant, advising Fortune 500s and governments on post-2020 large language models. His work on artificial intelligence has been featured at NYU, with Microsoft AI and Google AI teams, at the University of Oxford’s 2021 debate on AI Ethics, and in the Leta AI (GPT-3) experiments viewed more than 4.5 million times. A contributor to the fields of human intelligence and peak performance, he has held positions as chairman for Mensa International, consultant to GE and Warner Bros, and memberships with the IEEE and IET. Technical highlights.