journal article Nov 22, 2022

Chatbot-Delivered Cognitive Behavioral Therapy in Adolescents With Depression and Anxiety During the COVID-19 Pandemic: Feasibility and Acceptability Study

Abstract
Background
Symptoms of depression and anxiety, suicidal ideation, and self-harm have escalated among adolescents to crisis levels during the COVID-19 pandemic. As a result, primary care providers (PCPs) are often called on to provide first-line care for these youth. Digital health interventions can extend mental health specialty care, but few are evidence based. We evaluated the feasibility of delivering an evidence-based mobile health (mHealth) app with an embedded conversational agent to deliver cognitive behavioral therapy (CBT) to symptomatic adolescents presenting in primary care settings during the pandemic.


Objective
In this 12-week pilot study, we evaluated the feasibility of delivering the app-based intervention to adolescents aged 13 to 17 years with moderate depressive symptoms who were treated in a practice-based research network (PBRN) of academically affiliated primary care clinics. We also obtained preliminary estimates of app acceptability, effectiveness, and usability.


Methods
This small, pilot randomized controlled trial (RCT) evaluated depressive symptom severity in adolescents randomized to the app or to a wait list control condition. The primary end point was depression severity at 4-weeks, measured by the 9-item Patient Health Questionnaire (PHQ-9). Data on acceptability, feasibility, and usability were collected from adolescents and their parent or legal guardian. Qualitative interviews were conducted with 13 PCPs from 11 PBRN clinics to identify facilitators and barriers to incorporating mental health apps in treatment planning for adolescents with depression and anxiety.


Results
The pilot randomized 18 participants to the app (n=10, 56%) or to a wait list control condition (n=8, 44%); 17 participants were included in the analysis, and 1 became ineligible upon chart review due to lack of eligibility based on documented diagnosis. The overall sample was predominantly female (15/17, 88%), White (15/17, 88%), and privately insured (15/17, 88%). Mean PHQ-9 scores at 4 weeks decreased by 3.3 points in the active treatment group (representing a shift in mean depression score from moderate to mild symptom severity categories) and 2 points in the wait list control group (no shift in symptom severity category). Teen- and parent-reported usability, feasibility, and acceptability of the app was high. PCPs reported preference for introducing mHealth interventions like the one in this study early in the course of care for individuals presenting with mild or moderate symptoms.


Conclusions
In this small study, we demonstrated the feasibility, acceptability, usability, and safety of using a CBT-based chatbot for adolescents presenting with moderate depressive symptoms in a network of PBRN-based primary care clinics. This pilot study could not establish effectiveness, but our results suggest that further study in a larger pediatric population is warranted. Future study inclusive of rural, socioeconomically disadvantaged, and underrepresented communities is needed to establish generalizability of effectiveness and identify implementation-related adaptations needed to promote broader uptake in pediatric primary care.


Trial Registration
ClinicalTrials.gov NCT04603053; https://clinicaltrials.gov/ct2/show/NCT04603053
Topics

No keywords indexed for this article. Browse by subject →

References
57
[2]
Perou, R MMWR Suppl (2013)
[4]
McCarthyCAnxiety in teens is rising: What's going on?American Academy of Pediatrics20192020-09-10https://www.healthychildren.org/English/health-issues/conditions/emotional-problems/Pages/Anxiety-Disorders.aspx
[6]
Global Prevalence of Depressive and Anxiety Symptoms in Children and Adolescents During COVID-19

Nicole Racine, Brae Anne McArthur, Jessica E. Cooke et al.

JAMA Pediatrics 10.1001/jamapediatrics.2021.2482
[7]
Heron, M Natl Vital Stat Rep (2019)
[9]
Curtin, SC Natl Vital Stat Rep (2020)
[13]
[22]
A fully automated conversational agent for promoting mental well-being: A pilot RCT using mixed methods

Kien Hoa Ly, Ann-Marie Ly, Gerhard Andersson

Internet Interventions 10.1016/j.invent.2017.10.002
[36]
DarcyAPEaneffSParajitoSRobinsonAFeasibility, acceptability, and effectiveness of a digital therapeutic application vs psychoeducation content for mild-to-moderate depression among adolescents2020Association for Behavioral and Cognitive TherapiesNovember 19-22Virtual2022
[37]
Improving Follow-Up for Adolescents With Depression in Primary Care

Jane Garbutt, Sherry Dodd, Shannon Rook et al.

Pediatrics 10.1542/peds.2021-051107
[39]
O'ReillyKProposed guidelines aim for safe, effective mobile health appsAmerican Medical Association20182022-09-10https://www.ama-assn.org/practice-management/digital/proposed-guidelines-aim-safe-effective-mobile-health-apps
[41]
The PHQ-9

Kurt Kroenke, Robert L. Spitzer, Janet B. W. Williams

Journal of General Internal Medicine 10.1046/j.1525-1497.2001.016009606.x
[43]
A Brief Measure for Assessing Generalized Anxiety Disorder

Robert L. Spitzer, Kurt Kroenke, Janet B. W. Williams et al.

Archives of Internal Medicine 10.1001/archinte.166.10.1092
[45]
Psychometric properties of the 7-item Generalized Anxiety Disorder Scale (GAD-7) in a large representative sample of Finnish adolescents

Kati Tiirikainen, Henna Haravuori, Klaus Ranta et al.

Psychiatry Research 10.1016/j.psychres.2018.12.004
[46]
Psychometric Properties of the Generalized Anxiety Disorder Scale-7 Item (GAD-7) in a Large Sample of Chinese Adolescents

Jiangang Sun, Kaixin Liang, Xinli Chi et al.

Healthcare 10.3390/healthcare9121709
[50]
Mossman, SA Ann Clin Psychiatry (2017)

Showing 50 of 57 references

Metrics
104
Citations
57
References
Details
Published
Nov 22, 2022
Vol/Issue
6(11)
Pages
e40242
Cite This Article
Ginger Nicol, Ruoyun Wang, Sharon Graham, et al. (2022). Chatbot-Delivered Cognitive Behavioral Therapy in Adolescents With Depression and Anxiety During the COVID-19 Pandemic: Feasibility and Acceptability Study. JMIR Formative Research, 6(11), e40242. https://doi.org/10.2196/40242