Deceptive Design in AI Companions: A Cognitive Bias Perspective on Risks for Teenagers

  • Aildson Ferreira UFRPE
  • George Valença UFRPE
  • Lucas Glasner Universidade Tiradentes

Resumo


AI companions are increasingly marketed as sources of companionship, emotional support, and intimate interactions. While these platforms may provide benefits to users, they also raise concerns regarding design strategies that encourage prolonged engagement and emotional attachment. This paper investigates deceptive design patterns in AI companions from a psychological perspective. We examined the relationship between platform features and cognitive biases through a systematic inspection of onboarding processes, interaction flows, monetization mechanisms, and age-access controls in Replika, Character.AI, and Candy AI. The analysis focused on patterns related to anthropomorphism, persuasive language, fear of missing out, addictive design, and emotional attachment. Our findings suggest that these platforms incorporate features that may exploit cognitive biases to encourage engagement and foster emotional dependency. Such practices may increase users’ susceptibility to manipulative interactions and influence perceptions of social relationships. We discuss the implications of these findings through the lens of cognitive psychology, highlighting the need for greater transparency and more responsible design practices, and demonstrating how cognitive biases can serve as an analytical lens for identifying manipulative mechanisms in AI companion platforms.
Palavras-chave: AI companions, deceptive design, cognitive biases, teenagers

Referências

Vibhor Agarwal, Ke Zhou, Edyta Paulina Bogucka, and Daniele Quercia. 2026. Frictionless Love: Associations Between AI Companion Roles and Behavioral Addiction. arXiv:2604.20011 [cs.CY] [link]

Luigi Bonetti. 2009. The impact of interactive digital media on children’s creative thinking. Ph. D. Dissertation. Queensland University of Technology, Brisbane. [link] Dissertation, Accessed: 2026-05-31.

Brazilian Internet Steering Committee. 2026. Survey on Internet use by children and adolescents in Brazil: TIC Kids Online Brazil 2025. Technical Report. Brazilian Internet Steering Committee, São Paulo. [link] Accessed: 2026-06-12.

Myra Cheng, Cinoo Lee, Pranav Khadpe, Sunny Yu, Dyllan Han, and Dan Jurafsky. 2026. Sycophantic AI decreases prosocial intentions and promotes dependence. Science 391, 6792 (2026), eaec8352.

Minh Duc Chu, Yifan Wu, Zhiyi Chen, Angel Hsing-Chi Hwang, and Luca Luceri. 2026. When Chatbots Accommodate: What AI Companions Optimize for in Vulnerable Conversations. arXiv:2606.04431 [cs.HC] [link]

CNN Brasil. 2024. 1 em cada 10 brasileiros usa chat de IA como amigo ou conselheiro, diz pesquisa. [link] Acesso em: 22 jun. 2026.

Common Sense Media. 2025. Talk, Trust, and Trade-Offs: How and Why Teens Use AI Companions. Technical Report. Common Sense Media, San Francisco. [link] Accessed: 2026-05-31.

Conselho Federal de Psicologia. 2025. Chatbots, Inteligência Artificial e sua Saúde Mental: Um Guia para Navegar com Mais Segurança na Nova Fronteira Digital. Cartilha. Conselho Federal de Psicologia. [link] Acesso em: 22 jun. 2026.

Daniela S Cruzes and Tore Dyba. 2011. Recommended steps for thematic synthesis in software engineering. In 2011 international symposium on empirical software engineering and measurement. IEEE, 275–284.

Julian De Freitas, Zeliha Oğuz-Uğuralp, Ahmet Kaan Uğuralp, and Stefano Puntoni. 2026. AI Companions Reduce Loneliness. Journal of Consumer Research 52, 6 (04 2026), 1126–1148. arXiv: [link] DOI: 10.1093/jcr/ucaf040

N. Eyal. 2014. Hooked: How to build habit-forming products. Penguin UK, London.

Verónica Gaete. 2015. Desarrollo psicosocial del adolescente. Revista chilena de pediatría 86, 6 (2015), 436–443.

R. E. Guingrich and M. S. A. Graziano. 2025. A Longitudinal Randomized Control Study of Companion Chatbot Use: Anthropomorphism and Its Mediating Role on Social Impacts. arXiv preprint arXiv:2509.19515 (2025).

John S Hutton, Jessica Taylor Piotrowski, Kara Bagot, Fran Blumberg, Turhan Canli, Jason Chein, Dimitri A Christakis, Jordan Grafman, James A Griffin, Tom Hummer, et al. 2024. Digital media and developing brains: Concerns and opportunities. Current Addiction Reports 11, 2 (2024), 287–298.

Internet Matters. 2025. Me, myself & AI: understanding and safeguarding children’s use of AI chatbots. Technical Report. Internet Matters. [link] Accessed: 2026-05-31.

Internet Matters. 2026. Children’s Wellbeing in a Digital World: Index Report 2026. Technical Report. Internet Matters. [link] Accessed: 2026-05-31.

N. Kurian. 2025. AI’s empathy gap: The risks of conversational Artificial Intelligence for young children’s well-being and key ethical considerations for early childhood education and care. Contemporary Issues in Early Childhood 26, 1 (2025), 132–139.

Linnea Laestadius, Andrea Bishop, Michael Gonzalez, Diana Illenčík, and Celeste Campos-Castillo. 2022. Too human and not human enough: A grounded theory analysis of mental health harms from emotional dependence on the social chatbot Replika. New Media & Society (2022). [link]

Qingchuan Li, Yan Luximon, and Jiaxin Zhang. 2023. The influence of anthropomorphic cues on patients’ perceived anthropomorphism, social presence, trust building, and acceptance of health care conversational agents: within-subject web-based experiment. Journal of medical Internet research 25 (2023), e44479.

Sonia Livingstone and Mariya Stoilova. 2021. The 4Cs: Classifying online risk to children. (2021).

Ning Ma, Ruslana Khynevych, Yunqiang Hao, and Yahui Wang. 2025. Effect of anthropomorphism and perceived intelligence in chatbot avatars of visual design on user experience: accounting for perceived empathy and trust. Frontiers in Computer Science 7 (2025), 1531976.

Daniel Marques and Thiago Falcão. 2026. Design persuasivo e mediação tecnológica em plataformas digitais de apostas: práticas e dilemas éticos de designers e desenvolvedores. Arcos Design 19, 1 (2026).

Thomas Mildner, Gian-Luca Savino, Philip R. Doyle, Benjamin R. Cowan, and Rainer Malaka. 2023. About Engaging and Governing Strategies: A Thematic Analysis of Dark Patterns in Social Networking Services. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). ACM, 1–15. DOI: 10.1145/3544548.3580695

Débora Ferreira Moura, Higor De Sousa Moura, Graziela De Moraes Rubin Filgueiras, Sandra Elisa De Assis Freire, Fauston Negreiros, and Emerson Diógenes De Medeiros. 2021. Fear of missing out (FoMO), mídias sociais e ansiedade: Uma revisão sistemática. Psicología, Conocimiento y Sociedad 11, 3 (2021), 99–114.

M. Namvarpour et al. 2026. Understanding Teen Overreliance on AI Companion Chatbots Through Self-Reported Reddit Narratives. In Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems. ACM, New York, 1–19.

Peggy M.L. Ng, Calvin Wan, Daisy Lee, Irene Garnelo-Gomez, and Mei Mei Lau. 2025. I love you, my AI companion! Do you? Perspectives from the Triangular Theory of Love and Attachment Theory. Internet Research (2025). DOI: 10.1108/INTR-11-2024-1783

Thiellen Oliveira, Thiago Coleti, and Marcelo Morandini. 2023. Dark Patterns nas Redes Sociais. O design enganoso e o impacto no livre-arbítrio dos usuários. In Anais do XIV Workshop sobre Aspectos da Interação Humano-Computador para a Web Social (Maceió/AL). SBC, Porto Alegre, RS, Brasil, 64–71. DOI: 10.5753/waihcws.2023.233765

World Health Organization et al. 1999. Programming for adolescent health and development: Report of a WHO/UNFPA/UNICEF study group on programming for adolescent health. World Health Organization.

N. G. Packin and K. Chagal-Feferkorn. 2024. This is not a game: The addictive allure of digital companions. Seattle University Law Review 48 (2024), 693.

Thiago Henrique Roza, Bruno Braga Montezano, Jair Augusto Bottega, and Ives Cavalcante Passos. 2026. AI companions: the emerging phenomenon of artificial intelligence-based friends, lovers and informal therapists. Journal of psychiatric research 192 (2026), 139–141.

Thomas Schilling, Michael Bošnjak, Colin Gray, Stuart Barnes, and Anastasia Sergeeva. 2024. Understanding Deceptive User Interface Designs: How They Unduly Influence Customers’ Choices: A Topical Issue of the Zeitschrift Für PsychologieUnderstanding Deceptive User Interface Designs: How They Unduly Influence Customers’ Choices: A Topical Issue of the Zeitschrift Für Psychologie. 296 pages. DOI: 10.1027/2151-2604/a000557

X. Sun, Y. Wang, and B. T. McDaniel. 2026. AI companions and adolescent social relationships: Benefits, risks, and bidirectional influences. Child Development Perspectives 2026 (2026), 9.

Sherry Turkle. 2015. Reclaiming conversation: The power of talk in a digital age. Penguin.

Tianling Xie and Iryna Pentina. 2022. Attachment Theory as a Framework to Understand Relationships with Social Chatbots: A Case Study of Replika. Proceedings of the 55th Hawaii International Conference on System Sciences (2022). DOI: 10.24251/hicss.2022.258

Y. Yu et al. 2026. Principles of Safe AI Companions for Youth: Parent and Expert Perspectives. In Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems. ACM, New York, 1–21.
Publicado
27/10/2026
FERREIRA, Aildson; VALENÇA, George; GLASNER, Lucas. Deceptive Design in AI Companions: A Cognitive Bias Perspective on Risks for Teenagers. In: BRAZILIAN SYMPOSIUM ON MULTIMEDIA AND THE WEB (WEBMEDIA), 32. , 2026, Lavras/MG. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2026 . p. 198-207. DOI: https://doi.org/10.5753/webmedia.2026.30695.

Artigos mais lidos do(s) mesmo(s) autor(es)

1 2 3 > >>