RT Journal Article T1 Teaching Human Poses Interactively to a Social Robot A1 González Pacheco, Víctor A1 Malfaz Vázquez, María Ángeles A1 Fernández Rebollo, Fernando A1 Salichs Sánchez-Caballero, Miguel AB The main activity of social robots is to interact with people. In order to do that, the robot must be able to understand what the user is saying or doing. Typically, this capability consists of pre-programmed behaviors or is acquired through controlled learning processes, which are executed before the social interaction begins. This paper presents a software architecture that enables a robot to learn poses in a similar way as people do. That is, hearing its teacher's explanations and acquiring new knowledge in real time. The architecture leans on two main components: an RGB-D (Red-, Green-, Blue- Depth) -based visual system, which gathers the user examples, and an Automatic Speech Recognition (ASR) system, which processes the speech describing those examples. The robot is able to naturally learn the poses the teacher is showing to it by maintaining a natural interaction with the teacher. We evaluate our system with 24 users who teach the robot a predetermined set of poses. The experimental results show that, with a few training examples, the system reaches high accuracy and robustness. This method shows how to combine data from the visual and auditory systems for the acquisition of new knowledge in a natural manner. Such a natural way of training enables robots to learn from users, even if they are not experts in robotics. PB MDPI SN 1424-8220 YR 2013 FD 2013-09-01 LK https://hdl.handle.net/10016/18607 UL https://hdl.handle.net/10016/18607 LA eng NO The authors gratefully acknowledge the funds provided by the Spanish MICINN (Ministry ofScience and Innovation) through the project “Aplicaciones de los robots sociales”, DPI2011-26980and the project “Diseno, Planificación Automática Y Evaluación De Terapias De Neuro-RehabilitaciónDirigidas Por Un Robot Social E Interactivo” (TIN2012-38079-C03-02), from the Spanish Ministry ofEconomy and Competitiveness. DS e-Archivo RD 27 jul. 2024