Robot mirroring: Promoting Empathy with an Artificial Agent by Reflecting the User's Physiological Affective States

Abstract

Self-tracking aims to increase awareness, decrease undesired behaviors, and ultimately lead towards a healthier lifestyle. However, inappropriate communication of self-tracking results might cause the opposite effect. Subtle self-tracking feedback is an alternative that can be provided with the aid of an artificial agent representing the self. Hence, we propose a wearable pet that reflects the user’s affective states through visual and haptic feedback. By eliciting empathy and fostering helping behaviors towards it, users would indirectly help themselves without explicit feedback. A wearable prototype was built, and three user studies performed to evaluate the appropriateness of the proposed affective representations. Visual representations using facial and body cues were clear for valence and less clear for arousal. Haptic interoceptive patterns emulating heart-rate levels matched the desired feedback urgency levels with a saturation frequency. The integrated visuo-haptic representations matched to participants own affective experience. From the results, we derived three design guidelines for future robot mirroring wearable systems: physical embodiment, interoceptive feedback, and customization.

Publication
In 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)
Monica Perusquía-Hernández
Monica Perusquía-Hernández
Affective Computing Scientist, Concept, UX/IU designer

My research interests include HCI, Affective Computing, Artificial Intelligence and Biosignal Processing.

Marisabel Cuberos Balda
Marisabel Cuberos Balda
Visual Interaction Designer

My main goal is to increase scientific knowledge and findings to other professionals and the general public, through assistance to other researchers in visual communication and graphical support.

David Antonio Gómez Jáuregui
David Antonio Gómez Jáuregui
Affective Computing Scientist, Stress specialist

My research interests are focused on creating new ways of natural user interaction with computers by detecting emotions, gestural and non-verbal behaviours from users.

Diego Paez-Granados
Diego Paez-Granados
Robotics Engineer, Human-Robot Interaction

I work on soft robotics designs and control methods for assisting people with mobility impairments in posture transitions and locomotion, based on soft and compliance principles for robot design and control.

Felix Dollack
Felix Dollack
AI in healthcare, Audio specialist

My research interests include multimodal human sensing, affective computing and generative and explainable artificial intelligence.

José V. Salazar L.
José V. Salazar L.
Robotics Engineer, Haptics specialist

Jose Victorio Salazar Luces is an Assistant Professor at Tohoku University, Japan. His interests are Haptics, Assistive Robotics and Wearable Devices.