A Motivation-Driven Incremental Learning Framework for Robotics

• Letícia M. Berto UNICAMP https://orcid.org/0000-0001-5599-192X
• Ricardo R. Gudwin UNICAMP https://orcid.org/0000-0002-9666-3954
• Esther L. Colombini UNICAMP https://orcid.org/0000-0003-0467-3133

DOI: https://doi.org/10.5753/ctd.2026.19439

Resumo

This thesis presents a computational framework for intrinsically motivated autonomous agents, formalizing intrinsic motivation (IM) as a multi-objective reinforcement learning problem integrating drive regulation, hedonic valuation, hierarchical need prioritization, and Theory of Mind, enabling adaptive, long-term decision-making and socially aware interaction. Validated on simulated and physical robotic platforms, the framework demonstrates improved behavioral stability, policy reshaping via hedonic modulation, and enhanced cooperation among agents with compatible motivational profiles and one altruistic agent. This work extends beyond robotics, offering a computational model of IM that bridges cognitive science and autonomous decision-making.

Referências

Bechara, A., Damasio, A. R., Damasio, H., and Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition, 50(1-3):7–15.

Berto, L., Costa, P., Simões, A., Gudwin, R., and Colombini, E. (2024). A motivational-based learning model for mobile robots. Cognitive Systems Research, 88:101278.

Berto, L., Hellou, M., Sciutti, A., Gudwin, R., Colombini, E., and Cangelosi, A. (2025a). A theory of mind motivational framework for social interaction with autonomous cognitive robots. In 2025 34th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pages 429–436.

Berto, L., Tanevska, A., Cirne, A., Costa, P., Simões, A., Gudwin, R., Rea, F., Colombini, E., and Sciutti, A. (2025b). Curiosity and affect-driven cognitive architecture for hri. IEEE Transactions on Affective Computing, pages 1–18.

Berto, L. M., Costa, P. D. P., Simoes, A. S., Gudwin, R. R., and Colombini, E. L. (2021). An iowa gambling task-based experiment applied to robots: A study on long-term decision making. In 2021 IEEE International Conference on Development and Learning (ICDL), pages 1–6.

Breazeal, C. (2003). Toward sociable robots. Robotics and autonomous systems, 42(3):167–175.

Breazeal, C. (2004). Designing sociable robots. MIT press, United States of America.

Breazeal, C. et al. (1998). A motivational system for regulating human-robot interaction. In Aaai/iaai, pages 54–61.

Cañamero, D. (1997). A hormonal model of emotions for behavior control. VUB AI-Lab Memo, 2006:1–10.

Cao, H.-L., Gómez Esteban, P., Albert, D. B., Simut, R., Van de Perre, G., Lefeber, D., and Vanderborght, B. (2017). A collaborative homeostatic-based behavior controller for social robots in human–robot interaction experiments. International Journal of Social Robotics, 9(5):675–690.

Cos, I., Cañamero, L., Hayes, G. M., and Gillies, A. (2013). Hedonic value: Enhancing adaptation for motivated agents. Adaptive Behavior, 21(6):465–483.

Goodrich, M. A., Schultz, A. C., et al. (2008). Human–robot interaction: a survey. Foundations and Trends® in Human–Computer Interaction, 1(3):203–275.

Hellou, M., Vinanzi, S., and Cangelosi, A. (2023). Bayesian theory of mind for false belief understanding in human-robot interaction. In 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pages 1893–1900. IEEE.

Hellou, M., Vinanzi, S., and Cangelosi, A. (2024). Where is my favourite toy? inferring the mental states of users in false belief understanding. In 2024 IEEE International Conference on Development and Learning (ICDL), pages 1–8. IEEE.

Hull, C. L. (1943). Principles of behavior: An introduction to behavior theory.

Konidaris, G. and Barto, A. (2006). An adaptive robot motivational system. In International Conference on Simulation of Adaptive Behavior, pages 346–356. Springer.

Lewis, M. and Canamero, L. (2016). Hedonic quality or reward? a study of basic pleasure in homeostasis and decision making of a motivated autonomous robot. Adaptive Behavior, 24(5):267–291.

Maslow, A. H. (1981). Motivation and personality. Prabhat Prakashan, New Delhi.

Romeo, M., McKenna, P. E., Robb, D. A., Rajendran, G., Nesset, B., Cangelosi, A., and Hastie, H. (2022). Exploring theory of mind for human-robot collaboration. In 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pages 461–468. IEEE.

Salichs, M. A. and Malfaz, M. (2011). A new approach to modeling emotions and their use on a decision-making system for artificial agents. IEEE Transactions on affective computing, 3(1):56–68.

Scassellati, B. (2002). Theory of mind for a humanoid robot. Autonomous Robots, 12:13–24.

Vinanzi, S., Patacchiola, M., Chella, A., and Cangelosi, A. (2019). Would a robot trust you? developmental robotics model of trust and theory of mind. Philosophical Transactions of the Royal Society B, 374(1771):20180032.

Yu, C., Serhan, B., and Cangelosi, A. (2024). Top-tom: Trust-aware robot policy with theory of mind. In 2024 IEEE International Conference on Robotics and Automation (ICRA), pages 7888–7894. IEEE.