journal article Jul 29, 2025

Trust in Artificial Intelligence–Based Clinical Decision Support Systems Among Health Care Workers: Systematic Review

Abstract
Abstract

Background
Artificial intelligence–based clinical decision support systems (AI-CDSSs) have enhanced personalized medicine and improved the efficiency of health care workers. Despite these opportunities, trust in these tools remains a critical factor for their successful integration into practice. Existing research lacks synthesized insights and actionable recommendations to guide the development of AI-CDSSs that foster trust among health care workers.


Objective
This systematic review aims to identify and synthesize key factors that influence health care workers’ trust in AI-CDSSs and to provide actionable recommendations for enhancing their trust in these systems.


Methods
We conducted a systematic review of published studies from January 2020 to November 2024, retrieved from PubMed, Scopus, and Google Scholar. Inclusion criteria focused on studies that examined health care workers’ perceptions, experiences, and trust in AI-CDSSs. Studies in non–English languages and those unrelated to health care settings were excluded. Two independent reviewers followed the Cochrane Collaboration Handbook and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 guidelines. Analysis was conducted using a developed data charter. The Critical Appraisal Skills Programme tool was applied to assess the quality of the included studies and to evaluate the risk of bias, ensuring a rigorous and systematic review process.


Results
A total of 27 studies met the inclusion criteria, involving diverse health care workers, predominantly in hospitalized settings. Qualitative methods were the most common (n=16, 59%), with sample sizes ranging from small focus groups to cohorts of over 1000 participants. Eight key themes emerged as pivotal in improving health care workers’ trust in AI-CDSSs: (1) System Transparency, emphasizing the need for clear and interpretable AI; (2) Training and Familiarity, highlighting the importance of knowledge sharing and user education; (3) System Usability, focusing on effective integration into clinical workflows; (4) Clinical Reliability, addressing the consistency and accuracy of system performance; (5) Credibility and Validation, referring to how well the system performs across diverse clinical contexts; (6) Ethical Consideration, examining medicolegal liability, fairness, and adherence to ethical standards;(7) Human Centric Design, pioritizing patient centered approaches; (8) Customization and Control, highlighting the need to tailor tools to specific clinical needs while preserving health care providers’ decision-making autonomy. Barriers to trust included algorithmic opacity, insufficient training, and ethical challenges, while enabling factors for health care workers’ trust in AI-CDSS tools were transparency, usability, and clinical reliability.


Conclusions
The findings highlight the need for explainable AI models, comprehensive training, stakeholder involvement, and human-centered design to foster health care workers’ trust in AI-CDSSs. Although the heterogeneity of study designs and lack of specific data limit further analysis, this review bridges existing gaps by identifying key themes that support trust in AI-CDSSs. It also recommends that future research include diverse demographics, cross-cultural perspectives, and contextual differences in trust across various health care professions.
Topics

No keywords indexed for this article. Browse by subject →

References
73
[1]
Rezaeian O Bayrak AE Asan O . An architecture to support graduated levels of trust for cancer diagnosis with AI. Presented at: International Conference on Human-Computer Interaction Communications in Computer and Information Science 2119 CCIS; Jun 29 to Jul 4, 2024:344-351; Washington, DC. 2024.[doi: 10.1007/978-3-031-61966-3_37] 10.1007/978-3-031-61966-3_37
[2]
Stacy "Qualitative evaluation of an artificial intelligence-based clinical decision support system to guide rhythm management of atrial fibrillation: survey study" JMIR Form Res 10.2196/36443
[3]
Henry "Human-machine teaming is key to AI adoption: clinicians’ experiences with a deployed machine learning system" NPJ Digit Med 10.1038/s41746-022-00597-7
[4]
Zheng "Clinical needs assessment of a machine learning-based asthma management tool: user-centered design approach" JMIR Form Res 10.2196/45391
[5]
Jones "Artificial intelligence and clinical decision support: clinicians’ perspectives on trust, trustworthiness, and liability" Med Law Rev 10.1093/medlaw/fwad013
[6]
Dlugatch "AI-driven decision support systems and epistemic reliance: a qualitative study on obstetricians’ and midwives’ perspectives on integrating AI-driven CTG into clinical decision making" BMC Med Ethics 10.1186/s12910-023-00990-1
[7]
Yoon "Assessing the utility, impact, and adoption challenges of an artificial intelligence-enabled prescription advisory tool for type 2 diabetes management: qualitative study" JMIR Hum Factors 10.2196/50939
[8]
Exploring nurses’ awareness and attitudes toward artificial intelligence: Implications for nursing practice

Majed Mowanes Alruwaili, Fuad H. Abuadas, Mohammad Alsadi et al.

DIGITAL HEALTH 10.1177/20552076241271803
[9]
Ma S Lei Y Wang X et al. Who should I trust: AI or myself? Leveraging human and AI correctness likelihood to promote appropriate trust in AI-assisted decision-making. Presented at: CHI ’23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems; Apr 23-28, 2023; Hamburg, Germany. Apr 19, 2023.[Accessed 12-11-2024] [doi: 10.1145/3544548.3581058] 10.1145/3544548.3581058
[10]
How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies

Oleksandra Vereschak, Gilles Bailly, Baptiste Caramiaux

Proceedings of the ACM on Human-Computer Interacti... 10.1145/3476068
[11]
Vereschak O Alizadeh F Bailly G Caramiaux B . Trust in AI-assisted decision making: perspectives from those behind the system and those for whom the decision is made. Presented at: CHI ’24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems; May 11-16, 2024; Honolulu, HI. May 11, 2024.[doi: 10.1145/3613904.3642018] 10.1145/3613904.3642018
[12]
Chiang CW Lu Z Li Z Yin M . Enhancing AI-assisted group decision making through LLM-powered devil’s advocate. Presented at: IUI ’24: Proceedings of the 29th International Conference on Intelligent User Interfaces; Mar 18-21, 2024; Greenville, SC. Mar 18, 2024.[doi: 10.1145/3640543.3645199] 10.1145/3640543.3645199
[13]
Amann "Expectations and attitudes towards medical artificial intelligence: a qualitative study in the field of stroke" PLoS One 10.1371/journal.pone.0279088
[14]
Cochrane-Campbell Handbook for Qualitative Evidence Synthesis. The Cochrane Collaboration; URL: https://training.cochrane.org/cochrane-campbell-handbook-qualitative-evidence-synthesis
[15]
Higgins JPT Thomas J Chandler J et al, editors. Chapter 3: defining the criteria for including studies and how they will be grouped for the synthesis. In: Cochrane Handbook for Systematic Reviews of Interventions. The Cochrane Collaboration; URL: https://training.cochrane.org/handbook/current/chapter-03
[16]
PRISMA. PRISMA 2020 checklist. URL: https://www.prisma-statement.org/prisma-2020-checklist [Accessed 19-11-2024]
[17]
Critical Appraisal Skills Programme “Qualitative Studies Checklist - CASP. Critical Appraisal Skills Programme. URL: https://casp-uk.net/casp-tools-checklists/qualitative-studies-checklist [Accessed 28-11-2024]
[18]
The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers

Quan Nha Hong, Sergi Fàbregues, Gillian Bartlett et al.

Education for Information 10.3233/efi-180221
[19]
Data extraction for intervention systematic reviews. Covidence. URL: https://www.covidence.org/resource/data-extraction-for-intervention-systematic-reviews [Accessed 28-11-2024]
[20]
Jacobs M He J Pradier FM et al. Designing ai for trust and collaboration in time-constrained medical decisions: a sociotechnical lens. Presented at: CHI ’21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems; May 8-13, 2021; Yokohama, Japan. May 6, 2021.[doi: 10.1145/3411764.3445385] 10.1145/3411764.3445385
[21]
Wang D Wang L Zhang Z et al. “Brilliant AI doctor” in rural clinics: challenges in AI-powered clinical decision support system deployment. Presented at: CHI ’21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems; May 8-13, 2021:1-18; Yokohama, Japan. May 6, 2021.[doi: 10.1145/3411764.3445432] 10.1145/3411764.3445432
[22]
Micocci "Attitudes towards trusting artificial intelligence insights and factors to prevent the passive adherence of GPs: a pilot study" J Clin Med 10.3390/jcm10143101
[23]
Choudhury "Clinicians’ perceptions of an artificial intelligence-based blood utilization calculator: qualitative exploratory study" JMIR Hum Factors 10.2196/38411
[24]
Gunasekeran "Acceptance and perception of artificial intelligence usability in eye care (APPRAISE) for ophthalmologists: a multinational perspective" Front Med (Lausanne) 10.3389/fmed.2022.875242
[25]
Choudhury "Factors influencing clinicians’ willingness to use an AI-based clinical decision support system" Front Digit Health 10.3389/fdgth.2022.920662
[26]
Ankolekar "Clinician perspectives on clinical decision support systems in lung cancer: implications for shared decision-making" Health Expect 10.1111/hex.13457
[27]
Van Biesen "An exploration of expectations and perceptions of practicing physicians on the implementation of computerized clinical decision support systems using a Qsort approach" BMC Med Inform Decis Mak 10.1186/s12911-022-01933-3
[28]
Sivaraman V Bukowski LA Levin J Kahn JM Perer A . Ignore, trust, or negotiate: understanding clinician acceptance of AI-based treatment recommendations in health care. Presented at: CHI ’23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems; Apr 23-28, 2023; Hamburg, Germany. [doi: 10.1145/3544548.3581075] 10.1145/3544548.3581075
[29]
Bach AKP Nørgaard TM Brok JC van Berkel N . “If i had all the time in the world”: ophthalmologists’ perceptions of anchoring bias mitigation in clinical AI support. Presented at: CHI ’23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems; Apr 23-28, 2023; Hamburg, Germany. Apr 19, 2023.[doi: 10.1145/3544548.3581513] 10.1145/3544548.3581513
[30]
Burgess ER Jankovic I Austin M et al. Healthcare AI treatment decision support: design principles to enhance clinician adoption and trust. Presented at: CHI ’23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems; Apr 23-28, 2023; Hamburg, Germany. Apr 19, 2023.[doi: 10.1145/3544548.3581251] 10.1145/3544548.3581251
[31]
Liu "Using AI-generated suggestions from ChatGPT to optimize clinical decision support" J Am Med Inform Assoc 10.1093/jamia/ocad072
[32]
Anjara "Examining explainable clinical decision support systems with think aloud protocols" PLoS One 10.1371/journal.pone.0291443
[33]
Liu "Discrepancy between perceptions and acceptance of clinical decision support systems: implementation of artificial intelligence for vancomycin dosing" BMC Med Inform Decis Mak 10.1186/s12911-023-02254-9
[34]
Liaw "An assessment of how clinicians and staff members use a diabetes artificial intelligence prediction tool: mixed methods study" JMIR AI 10.2196/45032
[35]
Nair "Barriers and enablers for implementation of an artificial intelligence-based decision support tool to reduce the risk of readmission of patients with heart failure: stakeholder interviews" JMIR Form Res 10.2196/47335
[36]
Choudhury "Effect of risk, expectancy, and trust on clinicians’ intent to use an artificial intelligence system -- blood utilization calculator" Appl Ergon 10.1016/j.apergo.2022.103708
[37]
York "Clinician and computer: a study on doctors’ perceptions of artificial intelligence in skeletal radiography" BMC Med Educ 10.1186/s12909-022-03976-6
[38]
Elareed "Perception and opinion of physicians regarding artificial intelligence in Egypt" Egypt J Intern Med 10.21608/ejhm.2024.384066
[39]
Chen "Usability and clinician acceptance of a deep learning-based clinical decision support tool for predicting glaucomatous visual field progression" J Glaucoma 10.1097/ijg.0000000000002163
[40]
Haocan S . Human-AI Trust Scale. Center for Open Science. Nov 5, 2024. URL: https://osf.io/mk8d9 [Accessed 17-07-2025]
[41]
Developing trustworthy artificial intelligence: insights from research on interpersonal, human-automation, and human-AI trust

Yugang Li, Baizhou Wu, Yuqi Huang et al.

Frontiers in Psychology 10.3389/fpsyg.2024.1382693
[42]
Nasarian "Designing interpretable ML system to enhance trust in healthcare: a systematic review to proposed responsible clinician-AI-collaboration framework" Information Fusion 10.1016/j.inffus.2024.102412
[43]
Ma "The need for digital health education among next-generation health workers in China: a cross-sectional survey on digital health education" BMC Med Educ 10.1186/s12909-023-04407-w
[44]
Harari RE Ahmadi N Pourfalatoun S Al-Taweel A Shokoohi H . Clinician-AI collaboration for decision support in telemedicine: a randomized controlled trial study. Presented at: Proceedings of Conference on Cognitive and Computational Aspects of Situation Management 2023; Oct 16-19, 2023:81-89; Philadelphia, PA. [doi: 10.29007/9qxd] 10.29007/9qxd
[45]
Newton "How are clinicians’ acceptance and use of clinical decision support systems evaluated over time? A systematic review" Stud Health Technol Inform 10.3233/shti230967
[46]
Benrimoh "Using a simulation centre to evaluate preliminary acceptability and impact of an artificial intelligence-powered clinical decision support system for depression treatment on the physician-patient interaction" BJPsych Open 10.1192/bjo.2020.127
[47]
AI-Driven Clinical Decision Support Systems: An Ongoing Pursuit of Potential

Malek Elhaddad, Sara Hamam

Cureus 10.7759/cureus.57728
[48]
Gonzalez "Just another tool in their repertoire: uncovering insights into public and patient perspectives on clinicians’ use of machine learning in perioperative care" J Am Med Inform Assoc 10.1093/jamia/ocae257
[49]
He "Perceptions of primary care patients on the use of electronic clinical decision support tools to facilitate health care: a systematic review" Patient Educ Couns 10.1016/j.pec.2024.108290
[50]
Knop "Human factors and technological characteristics influencing the interaction of medical professionals with artificial intelligence-enabled clinical decision support systems: literature review" JMIR Hum Factors 10.2196/28639

Showing 50 of 73 references

Metrics
73
Citations
73
References
Details
Published
Jul 29, 2025
Vol/Issue
27
Pages
e69678-e69678
Cite This Article
Hein Minn Tun, Hanif Abdul Rahman, Lin Naing, et al. (2025). Trust in Artificial Intelligence–Based Clinical Decision Support Systems Among Health Care Workers: Systematic Review. Journal of Medical Internet Research, 27, e69678-e69678. https://doi.org/10.2196/69678