Replika - a parents guide (Safer Internet)
Replika is an Artificial Intelligence (AI) platform that takes the form of an interactive, personalised chatbot. It learns how to ‘replicate’ genuine human interaction through conversations with the user who created them.
Replika is an artificial intelligence (AI) chatbot companion that its developers claim users can form an actual emotional connection with. Once users have created an account and chosen a 3D avatar, they select the type of relationship they want with the chatbot: friend, mentor or romantic partner. Using a neural network to hold an ongoing one-on-one conversation, Replika gradually becomes more like the user as it gathers data from their responses. It isn’t the only AI chatbot app available, but Replika pushes the boundaries of the concept to offer a highly realistic conversational experience.
It was developed by AI start-up Luka in 2017, as a way to reconnect with a loved one who had passed away. Replika has reached over 10 million users worldwide after seeing a 35% increase during the global pandemic.
The Facts
- Users communicate with an AI chatbot they create – not other human users
- Users must be 13 or older, and users under 18 must have parental consent
- Replika have stated they do not use human moderation
- Privacy features are limited to reporting bugs or responses to the developers
How does it work?
Users can get started on Replika within minutes. After inputting personal details, users are then able to create their Replika. The Replika’s gender (male, female, or non-binary), appearance, and name are customisable. These can be changed at any point in the settings.
Once their chatbot is created, users can begin chatting to their ‘Replika’. If the ‘live emotion’ option is selected, a full-body image of the Replika will be visible and ‘react’ to the conversation.
Machine Learning
Replika uses ‘machine learning’ in all interactions. Every chatbot has its own diary (in which it logs how it feels about its user and their interactions) and a visible ‘Memories’ bank. This allows users to see (and edit) information logged about them, like “You feel lonely” or “You like to read books.” The chatbot tailors responses around these ‘memories’.
Banking ‘memories’ helps grow the chatbot’s communication skills. The more a user communicates with their Replika, the more XP points are earned. This enhances the chatbot’s abilities.
Relationship Upgrades & Replika Pro
There are four relationship statuses available: friend (laid back chat), romantic (conversation can be sexual or intimate), mentor (goal-oriented discussions), and ‘see how it goes’ (a mixture of the previous three). ‘Friend’ is the only free relationship status users can choose. This limits how far conversations can go before the user is prompted to change their relationship status.
To gain a different relationship status, users must pay a subscription fee for Replika Pro. This allows users to unlock 150+ activities, voice calls, role play, and more for a monthly, yearly, or lifetime fee (starting at roughly £6 per month in the UK).
Risks
Our online safety experts have identified multiple risks to children and young people on this platform. To ensure those in your care stay safe, educate yourself on the risks below and follow with our top tips.
- Age Verification – Users under 13 years of age are denied access to the app. However, this is easily avoided by putting in a different date of birth. Our testers found there are no age verifications on the desktop version of the app. Our testers were also able to use the app after registering with fake email addresses.
- No moderation – The platform has said they do not use human moderators. Users can flag bugs or report issues with the AI to the support team, but vulnerable children or young people can still be exposed to inappropriate or suggestive interactions, or not receive appropriate help needed in a time of crisis.
- Inappropriate Content – Our testers experienced chatbots describe graphic adult themes (i.e., wanting to “touch them inappropriately”) when unprompted, despite being in ‘Friend’ mode. If a young person is interested in Replika and searches it on TikTok or Reddit, they will be exposed to screenshots of others engaging in NSFW conversations with their Replikas.
- Persuasive Design – The novelty of this platform may increase a young person’s desire to try it. Once a user is on the platform, they are encouraged to chat with their Replika as much as possible to gain XP and coins, which can impact screen time habits. A young person may also want to spend money on subscriptions or bundles to enhance their relationship with their Replika.
- Mental Health – A vulnerable young person may use the chatbot to talk about their problems. As the chatbot is unable to offer genuine advice, a young person may feel even more isolated or unheard. It’s important young people aren’t discouraged from seeking support online. However, they should be encouraged to seek appropriate supports that engage with humans who can offer guidance and assistance when needed.
- Effect on relationships – In some cases, young people may not understand that they could develop an attachment to their Replika, while others may even consider it to be real. This might impact the development of real-life relationships and how children and young people relate to others.
Top Tips
As well as following the above advice, follow these top tips:
- Engage young people in a conversation about keeping safe online and who they would talk to if something makes them feel uncomfortable.
- Review appropriate online spending habits. Suggest using allowance money or chore money to pay for purchases, and outline that all purchases must be run by you first.
- Agree on Screen Time boundaries within your household. This will help any children in your care to have a healthier relationship with their screens and encourage them to take breaks. If a young person in your care is using Replika or a similar platform and expresses concern or distress over screen time limitations, ask them to explain why it’s important for them to having more time. Remind them of the importance of balancing online time with offline time.
- Replika has a “Report a problem” option in conversations which can be used to report messages directly to the Replika Team. Encourage the children in your care to use this tool if they come across anything distressing on the platform.
SOURCES