journal article Sep 28, 2023

Investigating AI Teammate Communication Strategies and Their Impact in Human-AI Teams for Effective Teamwork

Abstract
Recently, AI is integrating into teams to collaborate with humans as a teammate with the goal of achieving unprecedented team outcomes. Much of the coordination between humans and AI teammates relies on human-AI communication, which is challenging due to AI's limitations on natural language communication. Thus, it is essential to identify and develop effective communication strategies for AI teammates in human-AI teams to facilitate the coordination process. Through interviews with 60 participants who collaborated with an AI teammate in a multiplayer online game, in this paper, we explore communication strategies that humans expect AI teammates to apply to support human-AI coordination and collaboration in dyadic teaming environments, and how the AI teammate's communication can impact teaming processes. Our findings highlight four communication strategies AI teammates should apply to support their coordination with humans in dyadic teaming environments. We also find that AI teammates' proactive communication with humans could facilitate the development of human trust and situation awareness, whereas AI lacking such proactive communication is often not perceived as a teammate. Our study extends the current CSCW/HCI research on human-AI communication in teaming environments by shedding light on how communication should be structured in dyadic human-AI teams for effective and smooth collaboration.
Topics

No keywords indexed for this article. Browse by subject →

References
126
[10]
Kathy Charmaz. 2014. Constructing grounded theory. sage.
[14]
Nancy J Cooke Mustafa Demir and Nathan McNeese. 2016. Synthetic teammates as team players: Coordination of human and synthetic teammates. Technical Report. Cognitive Engineering Research Institute Mesa United States.
[15]
Nancy J Cooke, Jamie C Gorman, Christopher W Myers, and Jasmine L Duran. 2013. Interactive team cognition. Cognitive science, Vol. 37, 2 (2013), 255--285.
[18]
Nils Dahlb"ack, Arne Jönsson, and Lars Ahrenberg. 1993. Wizard of Oz studies-why and how. Knowledge-based systems, Vol. 6, 4 (1993), 258--266.
[21]
Mustafa Demir, Nathan J McNeese, and Nancy J Cooke. 2016. Team communication behaviors of the human-automation teaming. In 2016 IEEE international multi-disciplinary conference on cognitive methods in situation awareness and decision support (CogSIMA). IEEE, 28--34.
[24]
Wen Duan, Nathan J McNeese, and Rui Zhang. 2023. Communication in Human-AI Teaming. In Group Communication: An Advanced Introduction, Torsten Reimer, Ernest Park, and Joseph Bonito (Eds.). Routledge/Taylor and Francis.
[27]
Mica R Endsley. 1995. Measurement of situation awareness in dynamic systems. Human factors, Vol. 37, 1 (1995), 65--84.
[37]
Cristina B Gibson and Jennifer A Manuel. 2003. Building trust. Virtual teams that work (2003), 59--86.
[38]
Luis R Gomez-Mejia David B Balkin Robert L Cardy and Kenneth P Carson. 2007. Managing human resources. Pearson/Prentice Hall Upper Saddle River NJ.
[40]
Camilla Göras, Karolina Olin, Maria Unbeck, Karin Pukk-H"arenstam, Anna Ehrenberg, Mesfin Kassaye Tessma, Ulrica Nilsson, and Mirjam Ekstedt. 2019. Tasks, multitasking and interruptions among the surgical team in an operating room: a prospective observational study. BMJ open, Vol. 9, 5 (2019), e026410.
[46]
Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139--183.
[47]
Allyson I Hauptman, Wen Duan, and Nathan J Mcneese. 2022. The Components of Trust for Collaborating With AI Colleagues. In Companion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social Computing. 72--75.

Showing 50 of 126 references

Cited By
69
Proceedings of the ACM on Human-Com...
Proceedings of the ACM on Human-Com...
Metrics
69
Citations
126
References
Details
Published
Sep 28, 2023
Vol/Issue
7(CSCW2)
Pages
1-31
License
View
Cite This Article
Rui Zhang, Wen Duan, Christopher Flathmann, et al. (2023). Investigating AI Teammate Communication Strategies and Their Impact in Human-AI Teams for Effective Teamwork. Proceedings of the ACM on Human-Computer Interaction, 7(CSCW2), 1-31. https://doi.org/10.1145/3610072
Related

You May Also Like

Reliability and Inter-rater Reliability in Qualitative Research

Nora McDonald, Sarita Schoenebeck · 2019

889 citations

To Trust or to Think

Zana Buçinca, Maja Barbara Malaya · 2021

606 citations

Deconstructing Community-Based Collaborative Design

Christina Harrington, Sheena Erete · 2019

470 citations

User Perceptions of Smart Home IoT Privacy

Serena Zheng, Noah Apthorpe · 2018

373 citations