In recent years, the field of social-signal-processing (i.e. the automatic analysis of nonverbal cues in human-human social interactions) has made significant progress. From understanding social traits to social roles and interaction dynamics, this area of research has the potential to revolutionize various applications, such as intelligent vehicles and social robots. However, there are still several challenges that need to be addressed in order to unlock the full potential of this technology. In this blog post, we’ll explore the current state of this research and discuss the future directions to consider.
The studies in this field have made considerable progress in integrating various Artificial Intelligence (AI) concepts, computational methodologies, nonverbal cues, interaction environments, and sensor setups. Researchers have developed novel machine learning and deep learning techniques that are capable of detecting and estimating a wide range of social and psychological phenomena in different scenarios. The diversity of sensors used in these studies has also grown significantly, allowing for more unconstrained, in-the-wild, and long-duration interactions.
Despite the progress, there are several limitations and challenges that need to be addressed. Some of these include:
To advance this field, several future research directions have been proposed:
The field of automatic analysis of nonverbal cues in human social interactions holds great promise for various applications. By addressing the challenges and limitations, and focusing on the proposed future directions, researchers can continue to advance this area and develop systems that can effectively analyze and respond to human social interactions in real-world scenarios, ultimately leading to improved human-computer interactions and enhanced understanding of human behavior.
CIGDEM BEYAN, Department of Information Engineering and Computer Science (DISI), University of Trento, Italy
ALESSANDRO VINCIARELLI, School of Computing Science, University of Glasgow, UK. Advisory board member at Substrata
ALESSIO DEL BUE, Pattern Analysis and Computer Vision (PAVIS), Istituto Italiano di Tecnologia (IIT), Italy