Abstract
Increasing number of researchers and designers are envisioning a wide range of novel proactive conversational services for smart speakers such as context-aware reminders and restocking household items. When initiating conversational interactions proactively, smart speakers need to consider users' contexts to minimize disruption. In this work, we aim to broaden our understanding of opportune moments for proactive conversational interactions in domestic contexts. Toward this goal, we built a voice-based experience sampling device and conducted a one-week field study with 40 participants living in university dormitories. From 3,572 in-situ user experience reports, we proposed 19 activity categories to investigate contextual factors related to interruptibility. Our data analysis results show that the key determinants for opportune moments are closely related to both personal contextual factors such as busyness, mood, and resource conflicts for dual-tasking, and the other contextual factors associated with the everyday routines at home, including user mobility and social presence. Based on these findings, we discuss the need for designing context-aware proactive conversation management features that dynamically control conversational interactions based on users' contexts and routines.
Topics

No keywords indexed for this article. Browse by subject →

References
69
[2]
Piotr D. Adamczyk and Brian P. Bailey. 2004. If Not Now, when?: The Effects of Interruption at Different Moments Within Task Execution . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems ( Vienna, Austria) (CHI '04). ACM, New York, NY, USA, 271--278. https://doi.org/10.1145/985692.985727 10.1145/985692.985727 Piotr D. Adamczyk and Brian P. Bailey. 2004. If Not Now, when?: The Effects of Interruption at Different Moments Within Task Execution. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vienna, Austria) (CHI '04). ACM, New York, NY, USA, 271--278. https://doi.org/10.1145/985692.985727
[3]
Amazon. 2020. Alexa Skills. https://www.amazon.com/alexa-skills/b/?node=13727921011&ref_=topnav_storetab_a2s Amazon. 2020. Alexa Skills. https://www.amazon.com/alexa-skills/b/?node=13727921011&ref_=topnav_storetab_a2s
[4]
Amazon. 2020. Alexa Voice Shopping. https://www.amazon.com/alexa-voice-shopping/b?node=14552177011 Amazon. 2020. Alexa Voice Shopping. https://www.amazon.com/alexa-voice-shopping/b?node=14552177011
[11]
Ana Paula Chaves and Marco Aurélio Gerosa . 2019. How should my chatbot interact? A survey on human-chatbot interaction design. CoRR abs/1904.02743 ( 2019 ). arXiv:1904.02743 Ana Paula Chaves and Marco Aurélio Gerosa. 2019. How should my chatbot interact? A survey on human-chatbot interaction design. CoRR abs/1904.02743 (2019). arXiv:1904.02743
[12]
Marshini Chetty , Ja-Young Sung , and Rebecca E. Grinter . 2007. How Smart Homes Learn: The Evolution of the Networked Home and Household . In Proceedings of the 9th International Conference on Ubiquitous Computing ( Innsbruck, Austria) (UbiComp '07). Springer-Verlag, Berlin, Heidelberg, 127--144. Marshini Chetty, Ja-Young Sung, and Rebecca E. Grinter. 2007. How Smart Homes Learn: The Evolution of the Networked Home and Household. In Proceedings of the 9th International Conference on Ubiquitous Computing (Innsbruck, Austria) (UbiComp '07). Springer-Verlag, Berlin, Heidelberg, 127--144.
[15]
Scott Davidoff , Min Kyung Lee , Charles Yiu , John Zimmerman , and Anind K. Dey . 2006. Principles of Smart Home Control . In Proceedings of the 8th International Conference on Ubiquitous Computing ( Orange County, CA) (UbiComp'06). Springer-Verlag, Berlin, Heidelberg, 19--34. Scott Davidoff, Min Kyung Lee, Charles Yiu, John Zimmerman, and Anind K. Dey. 2006. Principles of Smart Home Control. In Proceedings of the 8th International Conference on Ubiquitous Computing (Orange County, CA) (UbiComp'06). Springer-Verlag, Berlin, Heidelberg, 19--34.
[16]
James Fogarty , Andrew J. Ko , Htet Htet Aung , Elspeth Golden , Karen P. Tang , and Scott E. Hudson . 2005. Examining Task Engagement in Sensor-based Statistical Models of Human Interruptibility . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems ( Portland, Oregon, USA) (CHI '05). ACM, New York, NY, USA, 331--340. https://doi.org/10.1145/1054972.1055018 10.1145/1054972.1055018 James Fogarty, Andrew J. Ko, Htet Htet Aung, Elspeth Golden, Karen P. Tang, and Scott E. Hudson. 2005. Examining Task Engagement in Sensor-based Statistical Models of Human Interruptibility. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Portland, Oregon, USA) (CHI '05). ACM, New York, NY, USA, 331--340. https://doi.org/10.1145/1054972.1055018
[17]
Google. 2020 . Google Assistant: Google Developers. https://developers.google.com/assistant Google. 2020. Google Assistant: Google Developers. https://developers.google.com/assistant
[18]
Edward Twitchell Hall . 1966. The hidden dimension . Vol. 609 . Garden City, NY : Doubleday . Edward Twitchell Hall. 1966. The hidden dimension. Vol. 609. Garden City, NY: Doubleday.
[20]
Joyce Ho and Stephen S. Intille . 2005. Using Context-aware Computing to Reduce the Perceived Burden of Interruptions from Mobile Devices . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems ( Portland, Oregon, USA) (CHI '05). ACM, New York, NY, USA, 909--918. https://doi.org/10.1145/1054972.1055100 10.1145/1054972.1055100 Joyce Ho and Stephen S. Intille. 2005. Using Context-aware Computing to Reduce the Perceived Burden of Interruptions from Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Portland, Oregon, USA) (CHI '05). ACM, New York, NY, USA, 909--918. https://doi.org/10.1145/1054972.1055100
[22]
Shamsi T. Iqbal and Brian P. Bailey. 2005. Investigating the Effectiveness of Mental Workload As a Predictor of Opportune Moments for Interruption . In CHI '05 Extended Abstracts on Human Factors in Computing Systems (Portland, OR, USA) (CHI EA '05). ACM , New York, NY, USA, 1489--1492. https://doi.org/10.1145/1056808.1056948 10.1145/1056808.1056948 Shamsi T. Iqbal and Brian P. Bailey. 2005. Investigating the Effectiveness of Mental Workload As a Predictor of Opportune Moments for Interruption. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (Portland, OR, USA) (CHI EA '05). ACM, New York, NY, USA, 1489--1492. https://doi.org/10.1145/1056808.1056948
[23]
Shamsi T. Iqbal and Brian P. Bailey. 2008. Effects of Intelligent Notification Management on Users and Their Tasks . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems ( Florence, Italy) (CHI '08). ACM, New York, NY, USA, 93--102. https://doi.org/10.1145/1357054.1357070 10.1145/1357054.1357070 Shamsi T. Iqbal and Brian P. Bailey. 2008. Effects of Intelligent Notification Management on Users and Their Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI '08). ACM, New York, NY, USA, 93--102. https://doi.org/10.1145/1357054.1357070
[24]
Medication Reminder Device for the Elderly Patients With Mild Cognitive Impairment

Tomoko Kamimura, Rina Ishiwata, Takenobu Inoue

American Journal of Alzheimer's Disease & Othe... 10.1177/1533317512450066
[28]
SeungJun Kim , Jaemin Chun , and Anind K. Dey . 2015. Sensors Know When to Interrupt You in the Car: Detecting Driver Interruptibility Through Monitoring of Peripheral Interactions . In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems ( Seoul, Republic of Korea) (CHI '15). ACM, New York, NY, USA, 487--496. https://doi.org/10.1145/2702123.2702409 10.1145/2702123.2702409 SeungJun Kim, Jaemin Chun, and Anind K. Dey. 2015. Sensors Know When to Interrupt You in the Car: Detecting Driver Interruptibility Through Monitoring of Peripheral Interactions. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). ACM, New York, NY, USA, 487--496. https://doi.org/10.1145/2702123.2702409
[33]
Jemin Lee , Uichin Lee , and Hyungshin Kim . 2019 . PASS: Reducing Redundant Interactions between a Smartphone and a Smartwatch for Energy Saving . IEEE Transactions on Mobile Computing ( 2019), 1--1. Jemin Lee, Uichin Lee, and Hyungshin Kim. 2019. PASS: Reducing Redundant Interactions between a Smartphone and a Smartwatch for Energy Saving. IEEE Transactions on Mobile Computing (2019), 1--1.
[40]
Sarah Mennicken , Jo Vermeulen , and Elaine M. Huang . 2014. From Today's Augmented Houses to Tomorrow's Smart Homes: New Directions for Home Automation Research . In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing ( Seattle, Washington) (UbiComp '14). Association for Computing Machinery, New York, NY, USA, 105--115. https://doi.org/10.1145/263 2048 .2636076 10.1145/2632048.2636076 Sarah Mennicken, Jo Vermeulen, and Elaine M. Huang. 2014. From Today's Augmented Houses to Tomorrow's Smart Homes: New Directions for Home Automation Research. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Seattle, Washington) (UbiComp '14). Association for Computing Machinery, New York, NY, USA, 105--115. https://doi.org/10.1145/2632048.2636076
[49]
Jingyan Qin , Zhibo Chen , Wenhao Zhang , Daisong Guan , Zhun Wu , and Min Zhao . 2019 . Research on Active Interaction Design for Smart Speakers Agent of Home Service Robot. In International Conference on Human-Computer Interaction. Springer, 253--263 . Jingyan Qin, Zhibo Chen, Wenhao Zhang, Daisong Guan, Zhun Wu, and Min Zhao. 2019. Research on Active Interaction Design for Smart Speakers Agent of Home Service Robot. In International Conference on Human-Computer Interaction. Springer, 253--263.

Showing 50 of 69 references

Metrics
59
Citations
69
References
Details
Published
Sep 04, 2020
Vol/Issue
4(3)
Pages
1-28
License
View
Funding
National Research Foundation of Korea Award: 2017M3C4A7083534
Cite This Article
Narae Cha, Auk Kim, Cheul Young Park, et al. (2020). Hello There! Is Now a Good Time to Talk?. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 4(3), 1-28. https://doi.org/10.1145/3411810
Related

You May Also Like

IndoTrack

Xiang Li, Daqing Zhang · 2017

338 citations

IMUTube

Hyeokhyen Kwon, Catherine Tong · 2020

130 citations

Discovering Smart Home Internet of Things Privacy Norms Using Contextual Integrity

Noah Apthorpe, Yan Shvartzshnaider · 2018

129 citations

He Is Just Like Me

Radhika Garg, Subhasree Sengupta · 2020

96 citations

VREED

Luma Tabbaa, Ryan Searle · 2021

93 citations