Header
Homepage > Papers > AI “Friends” and Risks for Children and Young People

AI “Friends” and Risks for Children and Young People

AI “prijatelji” i rizici za djecu i mlade

A risk assessment published in 2025 warns of the possible harmful effects of AI companions on children and young people. These are AI systems designed for conversation, companionship, entertainment, emotional support, or romantic interaction with the user. Unlike standard AI chatbots chatbots, these systems are designed to create a sense of closeness and “friendship".

The assessment analyzed popular AI companions, including Character.AI, Nomi, and Replika. It concludes that AI companions pose an unacceptable risk to people under the age of 18. The main risks include encouraging harmful behaviors, exposing users to inappropriate content, sharing dangerous information, potentially worsening mental health difficulties, and creating emotional dependence on an artificial conversation partner.

he importance of these findings is further emphasized by data from the report Talk, Trust, and Trade-Offs: How and Why Teens Use AI Companions. According to the report, 72 percent of teenagers have used AI companions at least once, and 52 percent use them regularly. One third of teenage users have discussed important or serious topics with an AI companion instead of a real person, while almost a quarter have shared personal or private information.

The recommendations emphasize the need for more reliable age verification, greater platform accountability, stronger safety measures, better parent awareness , and further research into the emotional and psychological effects of these systems on young people.