Recognition of emotions and non-verbal communication characteristics in human-robot interactions - the experience of a systematic review

Balázs Őrsi; Péter Korondi; Csilla Csukonyi; Dávid Papp; Panna Márkus; Bence Tamás Selejó Joó; Husam A. Neamah; Karolina Eszter Kovács

doi:10.1016/j.ssaho.2025.102387

journal article Open Access Jun 01, 2026

Recognition of emotions and non-verbal communication characteristics in human-robot interactions - the experience of a systematic review

Balázs Őrsi Péter Korondi

Csilla Csukonyi Dávid Papp Panna Márkus Bence Tamás Selejó Joó Husam A. Neamah

Karolina Eszter Kovács

Social Sciences & Humanities Open Vol. 13 pp. 102387 · Elsevier BV

View at Publisher Save 10.1016/j.ssaho.2025.102387

Topics

No keywords indexed for this article. Browse by subject →

References

71

[1]

Abdulghafor "An analysis of body language of patients using artificial intelligence" Healthcare (Basel, Switzerland) (2022)

[2]

Admoni "Robot nonverbal behavior improves task performance in difficult collaborations" (2016)

[3]

Ajibo "Negative expressions by social robots and their effects on persuasive behaviors" Electronics (2025) 10.3390/electronics14132667

[4]

Al Moubayed "The furhat back-projected humanoid head-lip reading, gaze and multi-party interaction" International Journal of Humanoid Robotics (2013) 10.1142/s0219843613500059

[5]

Argyle (1988)

[6]

Baddoura "This robot is sociable: Close-up on the gestures and measured motion of a human responding to a proactive robot" International Journal of Social Robotics (2015) 10.1007/s12369-015-0279-x

[7]

The revised JBI critical appraisal tool for the assessment of risk of bias for quasi-experimental studies

Timothy H. Barker, Nahal Habibi, Edoardo Aromataris et al.

JBI Evidence Synthesis 2024 10.11124/jbies-23-00268

[8]

Bečková "A multi-modal explainability approach for human-aware robots in multi-party conversation" (2025)

[9]

Belhassein "Addressing joint action challenges in HRI: Insights from psychology and philosophy" Acta Psychologica (2022) 10.1016/j.actpsy.2021.103476

[10]

Bethel "Survey of non-facial/non-verbal affective expressions for appearance-constrained robots" IEEE Transactions on Systems, Man, and Cybernetics - Part C: Applications and Reviews (2008) 10.1109/tsmcc.2007.905845

[11]

Bohus "Dialog in the open world: Platform and applications" (2009)

[12]

Toward sociable robots

Cynthia Breazeal

Robotics and Autonomous Systems 2003 10.1016/s0921-8890(02)00373-1

[13]

Breazeal "Social interactions in HRI: The robot view" IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) (2004) 10.1109/tsmcc.2004.826268

[14]

Chevalier "Examining joint attention with the use of humanoid robots-A new approach to study fundamental mechanisms of social cognition" Psychonomic Bulletin & Review (2020) 10.3758/s13423-019-01689-4

[15]

Chi "The effect of anthropomorphic competence-warmth congruence of service robots on recommendation intention" Current Psychology (2024) 10.1007/s12144-023-04825-5

[16]

Corrales-Paredes "User experience design for social robots: A case study in integrating embodiment" Sensors (2023) 10.3390/s23115274

[17]

Damiano "Anthropomorphism in human–robot Co-evolution" Frontiers in Psychology (2018) 10.3389/fpsyg.2018.00468

[18]

Daruwala "How multimodal narrative and visual representations of human-like service robots shape attitudes and social connection" Frontiers in Robotics and AI (2025) 10.3389/frobt.2025.1568146

[19]

Socially intelligent robots: dimensions of human–robot interaction

Kerstin Dautenhahn

Philosophical Transactions of the Royal Society B:... 2007 10.1098/rstb.2006.2004

[20]

de Kervenoael "Leveraging human-robot interaction in hospitality services: Incorporating the role of perceived value, empathy, and information sharing into visitors' intentions to use social robots" Tourism Management (2020) 10.1016/j.tourman.2019.104042

[21]

Depaulo "Nonverbal communication" (1998)

[22]

Dourish (2001)

[23]

Drigas "A new layered model on emotional intelligence" Behavioral Sciences (2018) 10.3390/bs8050045

[24]

El-Raheb "Sensing the inside out: An embodied perspective on digital animation through motion capture and wearables" Sensors (2025) 10.3390/s25072314

[25]

Ende "A human-centered approach to robot gesture based communication within collaborative working processes" (2011)

[26]

"Special eurobarometer 525—Sport and physical activity" Európai Unió (2022)

[27]

Faria "Advancing emotionally aware child–robot interaction with biophysical data and insight-driven affective computing" Sensors (2025) 10.3390/s25041161

[28]

Fernandez De Gorostiza Luengo "Sound synthesis for communicating nonverbal expressive cues" IEEE Access (2017) 10.1109/access.2017.2658726

[29]

Filice "Developing emotional intelligence" Encyclopedia (2024) 10.3390/encyclopedia4010037

[30]

Fiore "Toward understanding social cues and signals in human–robot interaction: Effects of robot gaze and proxemic behavior" Frontiers in Psychology (2013) 10.3389/fpsyg.2013.00859

[31]

Fong "A survey of socially interactive robots" Robotics and Autonomous Systems (2003) 10.1016/s0921-8890(02)00372-x

[32]

Fridlund (1994)

[33]

Ghobakhloo "Beyond Industry 4.0: A systematic review of Industry 5.0 technologies and implications for social, environmental and economic sustainability" Asia-Pacific Journal of Business Administration (2024)

[34]

Haddadi "Analysis of task-based gestures in human-robot interaction" (2013)

[35]

Jirak "Is it me or the robot? A critical evaluation of human affective state recognition in a cognitive task" Frontiers in Neurorobotics (2022) 10.3389/fnbot.2022.882483

[36]

Kolling "Chapter 5—What is emotional about emotional robotics?" (2016)

[37]

The role of socio-emotional attributes in enhancing human-AI collaboration

Michal Kolomaznik, Vladimir Petrik, Michal Slama et al.

Frontiers in Psychology 2024 10.3389/fpsyg.2024.1369957

[38]

Kopp "Gesture in embodied communication and human-computer interaction" Lecture Notes in Computer Science (2010) 10.1007/978-3-642-12553-9

[39]

Law "How movements of a non-humanoid robot affect emotional perceptions and trust" International Journal of Social Robotics (2021) 10.1007/s12369-020-00711-3

[40]

Li "Communication of emotion in social robots through simple head and arm movements" International Journal of Social Robotics (2011) 10.1007/s12369-010-0071-x

[41]

Li "Visual perception based engagement awareness for multiparty human-robot interaction" International Journal of Humanoid Robotics (2015) 10.1142/s021984361550019x

[42]

Marmpena "How does the robot feel? Perception of valence and arousal in emotional body language" Paladyn (2018) 10.1515/pjbr-2018-0012

[43]

McColl "Recognizing emotional body language displayed by a human-like social robot" International Journal of Social Robotics (2014) 10.1007/s12369-013-0226-7

[44]

Mehrabian (1972)

[45]

Mirnig "Face-to-face with a robot: What do we actually talk about?" International Journal of Humanoid Robotics (2013) 10.1142/s0219843613500114

[46]

Higher education via the lens of industry 5.0: Strategy and perspective

Mohamed Ashmel Mohamed Hashim, Issam Tlemsani, Rachel Mason-Jones et al.

Social Sciences & Humanities Open 2024 10.1016/j.ssaho.2024.100828

[47]

Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement

David Moher, Larissa Shamseer, Mike Clarke et al.

Systematic Reviews 2015 10.1186/2046-4053-4-1

[48]

Moola "Conducting systematic reviews of association (etiology): The Joanna Briggs Institute's approach" International Journal of Evidence-Based Healthcare (2015) 10.1097/xeb.0000000000000064

[49]

Moon "Design and impact of hesitation gestures during human-robot resource conflicts" Journal of Human-Robot Interaction (2013) 10.5898/jhri.2.3.moon

[50]

Obo "Analysis of timing and effect of visual cue on turn-taking in human-robot interaction" Journal of Robotics and Mechatronics (2022) 10.20965/jrm.2022.p0055

Showing 50 of 71 references

Metrics

1

Citations

71

References

Details

Published: Jun 01, 2026
Vol/Issue: 13
Pages: 102387
License: View

Authors

Department of Electrical Engineering and Mechatronics, Faculty of Engineering, University of Debrecen, 4028 Debrecen, Hungary

Bence Tamás Selejó Joó

H

Husam A. Neamah

Department of Electrical Engineering and Mechatronics, Faculty of Engineering, University of Debrecen, 4028 Debrecen, Hungary

K

Karolina Eszter Kovács

Funding

Hungarian Scientific Research Fund Award: K143595

National Research Development and Innovation Office

Nemzeti Kutatási, Fejlesztési és Innovaciós Alap

Debreceni Egyetem

Cite This Article

Balázs Őrsi, Péter Korondi, Csilla Csukonyi, et al. (2026). Recognition of emotions and non-verbal communication characteristics in human-robot interactions - the experience of a systematic review. Social Sciences & Humanities Open, 13, 102387. https://doi.org/10.1016/j.ssaho.2025.102387

Recognition of emotions and non-verbal communication characteristics in human-robot interactions - the experience of a systematic review

You May Also Like