Multimodal robotic storytelling integrating sound effects and background music

Sophia C. Steinhaeusser; Sophia Maier; Birgit Lugrin

doi:10.1016/j.chbah.2025.100248

journal article Open Access Mar 01, 2026

Multimodal robotic storytelling integrating sound effects and background music

Sophia C. Steinhaeusser

Sophia Maier

Birgit Lugrin

Computers in Human Behavior: Artificial Humans Vol. 7 pp. 100248 · Elsevier BV

View at Publisher Save 10.1016/j.chbah.2025.100248

Topics

No keywords indexed for this article. Browse by subject →

References

222

[1]

Adamczyk "Storytelling: Mit geschichten überzeugen" (2018)

[2]

Adams (2013)

[3]

Adams (2013)

[4]

Time Flies When You’re Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage1

Ritu Agarwal, Elena Karahanna

MIS Quarterly 2000 10.2307/3250951

[5]

Algoe "Witnessing excellence in action: the ’other-praising’ emotions of elevation, gratitude, and admiration" The Journal of Positive Psychology (2009) 10.1080/17439760802650519

[6]

Anders "How fast is the tempo in a happy music performance?" Frontiers in Human Neuroscience (2009) 10.3389/conf.neuro.09.2009.02.005

[7]

Appel "The transportation scale–short form (TS–SF)" Media Psychology (2015) 10.1080/15213269.2014.987400

[8]

Appel "The emotional robotic storyteller: On the influence of affect congruency on narrative transportation, robot perception, and persuasion" Computers in Human Behavior (2021) 10.1016/j.chb.2021.106749

[9]

Argstatter "Perception of basic emotions in music: Culture-specific or multicultural?" Psychology of Music (2016) 10.1177/0305735615589214

[10]

Arnal "Human screams occupy a privileged niche in the communication soundscape" Current Biology (2015) 10.1016/j.cub.2015.06.043

[11]

Association (2018)

[12]

Atkinson "Soaring through the sky" Music Theory Online (2019) 10.30535/mto.25.2.1

[13]

Au-Yeung (2022)

[14]

Aylett "Interactive narrative and story-telling" (2022)

[15]

Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots

Christoph Bartneck, Dana Kulić, Elizabeth Croft et al.

International Journal of Social Robotics 2009 10.1007/s12369-008-0001-3

[16]

Bartneck, C., Rosalia, C., Menges, R., & Deckers, I. (2005). Robot Abuse - A Limitation of the Media Equation. In Proceedings of the interact 2005 workshop on abuse.

[17]

Bartz "Gender differences in self-report measures of anger: The role of social desirability and negative affect" Journal of Social Behavior and Personality (1996)

[18]

Beament "The biology of music" Psychology of Music (1977) 10.1177/030573567751001

[19]

Beck "Towards an affect space for robots to display emotional body language" (2010)

[20]

Beck "Children interpretation of emotional body language displayed by a robot" (2011)

[21]

Bedoya "Even violins can cry: specifically vocal emotional behaviours also drive the perception of emotions in non-vocal music" Philosophical Transactions of the Royal Society B (2021) 10.1098/rstb.2020.0396

[22]

Benjamin "The case study: storytelling in the industrial age and beyond" On the Horizon (2006) 10.1108/10748120610708069

[23]

Berg "Relations between selected musical parameters and expressed emotions" (2005)

[24]

Blood "Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions" Nature Neuroscience (1999) 10.1038/7299

[25]

Boje "Stories of the storytelling organization: A postmodern analysis of disney as “Tamara-Land”" (2019)

[26]

Boltz "Musical soundtracks as a schematic influence on the cognitive processing of filmed events" Music Perception (2001) 10.1525/mp.2001.18.4.427

[27]

Borowski "Experimental study on sound quality of various audio fade lengths" (2018)

[28]

Brajša-Žganec "Personality traits and social desirability as predictors of subjective well-being" Psihologijske Teme (2011)

[29]

Breazeal "Social robotics" (2016) 10.1007/978-3-319-32552-1_72

[30]

Bresin "Emotion rendering in music: range and characteristic values of seven musical variables" Cortex; A Journal Devoted To the Study of the Nervous System and Behavior (2011) 10.1016/j.cortex.2011.05.009

[31]

Brinkmeier "Die maus, die sich fledermauste" (2019)

[32]

Brooke (1995)

[33]

Calvert "The selective use of sound effects and visual inserts for children’s television story comprehension" Journal of Applied Developmental Psychology (1987) 10.1016/0193-3973(87)90027-x

[34]

Caputo "Social desirability bias in self-reported well-being measures: Evidence from an online survey" Universitas Psychologica (2017) 10.11144/javeriana.upsy16-2.sdsw

[35]

Carr "The perceptual and emotional consequences of articulation in music" Music Perception (2023) 10.1525/mp.2023.40.3.202

[36]

Causer "Disney tech: Immersive storytelling through innovation" IEEE Potentials (2019) 10.1109/mpot.2019.2919851

[37]

Choo "Digital storytelling vs. Oral storytelling: An analysis of the art of telling stories now and then" Universal Journal of Educational Research (2020) 10.13189/ujer.2020.081907

[38]

Ciesla (2022)

[39]

Clark "Speaking pictures: the role of sound and orality in audio presentations of children’s picture books" New Review of Children’s Literature and Librarianship (2003) 10.1080/1361454032000232077

[40]

Cohen "Congurence-association model of music and multimedia: Origin and evolution" (2013)

[41]

Cohen "The role of music, sound effects & speech on absorption in a film: The congruence-associationist model of media cognition" Canadian Acoustics (2006)

[42]

Colm Hogan "The mind and its stories: Narrative unversals and human emotion" (2003)

[43]

Costa "Facial expressions and gestures to convey emotions with a humanoid robot" (2013)

[44]

Costabile "Effects of film music on psychological transportation and narrative persuasion" Basic and Applied Social Psychology (2013) 10.1080/01973533.2013.785398

[45]

Darwin (1998)

[46]

Davies "Musical meaning and expression" (1994)

[47]

de Graaf "Long-term acceptance of social robots in domestic environments: Insights from a user’s perspective" (2016)

[48]

Drew "Variations in reflex blink-rate during visual-motor tasks" Quarterly Journal of Experimental Psychology (1951) 10.1080/17470215108416776

[49]

Duffy "What is a social robot?" (1999)

[50]

Dumbari Ndiinee "Online vs face-to-face research participation: Which do research respondents prefer?" Mdooter Journal of Communication and Digital Technologies (2025)

Showing 50 of 222 references

Metrics

0

Citations

222

References

Details

Published: Mar 01, 2026
Vol/Issue: 7
Pages: 100248
License: View

Authors

S

Sophia C. Steinhaeusser

Cite This Article

Sophia C. Steinhaeusser, Sophia Maier, Birgit Lugrin (2026). Multimodal robotic storytelling integrating sound effects and background music. Computers in Human Behavior: Artificial Humans, 7, 100248. https://doi.org/10.1016/j.chbah.2025.100248

Multimodal robotic storytelling integrating sound effects and background music

You May Also Like