journal article Nov 21, 2022

Mental Health Chatbot for Young Adults With Depressive Symptoms During the COVID-19 Pandemic: Single-Blind, Three-Arm Randomized Controlled Trial

Abstract
Background
Depression has a high prevalence among young adults, especially during the COVID-19 pandemic. However, mental health services remain scarce and underutilized worldwide. Mental health chatbots are a novel digital technology to provide fully automated interventions for depressive symptoms.


Objective
The purpose of this study was to test the clinical effectiveness and nonclinical performance of a cognitive behavioral therapy (CBT)–based mental health chatbot (XiaoE) for young adults with depressive symptoms during the COVID-19 pandemic.


Methods
In a single-blind, 3-arm randomized controlled trial, participants manifesting depressive symptoms recruited from a Chinese university were randomly assigned to a mental health chatbot (XiaoE; n=49), an e-book (n=49), or a general chatbot (Xiaoai; n=50) group in a ratio of 1:1:1. Participants received a 1-week intervention. The primary outcome was the reduction of depressive symptoms according to the 9-item Patient Health Questionnaire (PHQ-9) at 1 week later (T1) and 1 month later (T2). Both intention-to-treat and per-protocol analyses were conducted under analysis of covariance models adjusting for baseline data. Controlled multiple imputation and δ-based sensitivity analysis were performed for missing data. The secondary outcomes were the level of working alliance measured using the Working Alliance Questionnaire (WAQ), usability measured using the Usability Metric for User Experience-LITE (UMUX-LITE), and acceptability measured using the Acceptability Scale (AS).


Results
Participants were on average 18.78 years old, and 37.2% (55/148) were female. The mean baseline PHQ-9 score was 10.02 (SD 3.18; range 2-19). Intention-to-treat analysis revealed lower PHQ-9 scores among participants in the XiaoE group compared with participants in the e-book group and Xiaoai group at both T1 (F2,136=17.011; P<.001; d=0.51) and T2 (F2,136=5.477; P=.005; d=0.31). Better working alliance (WAQ; F2,145=3.407; P=.04) and acceptability (AS; F2,145=4.322; P=.02) were discovered with XiaoE, while no significant difference among arms was found for usability (UMUX-LITE; F2,145=0.968; P=.38).


Conclusions
A CBT-based chatbot is a feasible and engaging digital therapeutic approach that allows easy accessibility and self-guided mental health assistance for young adults with depressive symptoms. A systematic evaluation of nonclinical metrics for a mental health chatbot has been established in this study. In the future, focus on both clinical outcomes and nonclinical metrics is necessary to explore the mechanism by which mental health chatbots work on patients. Further evidence is required to confirm the long-term effectiveness of the mental health chatbot via trails replicated with a longer dose, as well as exploration of its stronger efficacy in comparison with other active controls.


Trial Registration
Chinese Clinical Trial Registry ChiCTR2100052532; http://www.chictr.org.cn/showproj.aspx?proj=135744
Topics

No keywords indexed for this article. Browse by subject →

References
90
[1]
Mental Health and COVID-19: Early evidence of the pandemic’s impact: Scientific brief, 2 March 2022World Health Organization2022-05-30https://www.who.int/publications/i/item/WHO-2019-nCoV-Sci_Brief-Mental_health-2022.1
[3]
What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies

S. Clement, O. Schauman, T. Graham et al.

Psychological Medicine 10.1017/s0033291714000129
[8]
Rapid Systematic Review: The Impact of Social Isolation and Loneliness on the Mental Health of Children and Adolescents in the Context of COVID-19

Maria Elizabeth Loades, Eleanor Chatburn, Nina Higson-Sweeney et al.

Journal of the American Academy of Child & Ado... 10.1016/j.jaac.2020.05.009
[9]
Digital Mental Health Interventions for Depression, Anxiety, and Enhancement of Psychological Well-Being Among College Students: Systematic Review

Emily G Lattie, Elizabeth C Adkins, Nathan Winquist et al.

Journal of Medical Internet Research 10.2196/12869
[13]
McTear, M The Conversational Interface: Talking to Smart Devices (2016) 10.1007/978-3-319-32967-3
[15]
Chatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape

Aditya Nrusimha Vaidyam, Hannah Wisniewski, John David Halamka et al.

The Canadian Journal of Psychiatry 10.1177/0706743719828977
[19]
Conversational agents in healthcare: a systematic review

Liliana Laranjo, Adam G Dunn, Huong Ly Tong et al.

Journal of the American Medical Informatics Associ... 10.1093/jamia/ocy072
[22]
An overview of the features of chatbots in mental health: A scoping review

Alaa A. Abd-alrazaq, Mohannad Alajlani, Ali Abdallah Alalwan et al.

International Journal of Medical Informatics 10.1016/j.ijmedinf.2019.103978
[25]
Depression and Other Common Mental DisordersWorld Health Organization20172022-03-15https://www.who.int/publications/i/item/depression-global-health-estimates
[26]
Prevalence of mental disorders in China: a cross-sectional epidemiological study

Hong Wang, Zhaorui Liu, Xin Yu et al.

The Lancet Psychiatry 10.1016/s2215-0366(18)30511-x
[30]
The empirical status of cognitive-behavioral therapy: A review of meta-analyses

Andrew C. Butler, Jason E. Chapman, Evan M. Forman et al.

Clinical Psychology Review 10.1016/j.cpr.2005.07.003
[31]
Depression

Gin S Malhi, J John Mann

The Lancet 10.1016/s0140-6736(18)31948-2
[38]
A fully automated conversational agent for promoting mental well-being: A pilot RCT using mixed methods

Kien Hoa Ly, Ann-Marie Ly, Gerhard Andersson

Internet Interventions 10.1016/j.invent.2017.10.002
[49]
The Role of Common Factors in Psychotherapy Outcomes

Pim Cuijpers, Mirjam Reijnders, Marcus J. H. Huibers

Annual Review of Clinical Psychology 10.1146/annurev-clinpsy-050718-095424

Showing 50 of 90 references

Cited By
149
Metrics
149
Citations
90
References
Details
Published
Nov 21, 2022
Vol/Issue
24(11)
Pages
e40719
Cite This Article
Li Yang, Xiaokun Zhu, Bin Wu, et al. (2022). Mental Health Chatbot for Young Adults With Depressive Symptoms During the COVID-19 Pandemic: Single-Blind, Three-Arm Randomized Controlled Trial. Journal of Medical Internet Research, 24(11), e40719. https://doi.org/10.2196/40719