Security Implications of AI Chatbots in Health Care

Jingquan Li

doi:10.2196/47551

journal article Nov 28, 2023

Security Implications of AI Chatbots in Health Care

Jingquan Li

Journal of Medical Internet Research Vol. 25 pp. e47551 · JMIR Publications Inc.

View at Publisher Save 10.2196/47551

Abstract

Artificial intelligence (AI) chatbots like ChatGPT and Google Bard are computer programs that use AI and natural language processing to understand customer questions and generate natural, fluid, dialogue-like responses to their inputs. ChatGPT, an AI chatbot created by OpenAI, has rapidly become a widely used tool on the internet. AI chatbots have the potential to improve patient care and public health. However, they are trained on massive amounts of people’s data, which may include sensitive patient data and business information. The increased use of chatbots introduces data security issues, which should be handled yet remain understudied. This paper aims to identify the most important security problems of AI chatbots and propose guidelines for protecting sensitive health information. It explores the impact of using ChatGPT in health care. It also identifies the principal security risks of ChatGPT and suggests key considerations for security risk mitigation. It concludes by discussing the policy implications of using AI chatbots in health care.

Topics

No keywords indexed for this article. Browse by subject →

References

29

[1]

What is a chatbot?IBM20232023-08-30https://www.ibm.com/topics/chatbots

[2]

PaudelPChatGPT in health care2023-08-30https://medium.com/tech-guides/chatgpt-in-healthcare-c0cccb1a59bc

[3]

DuKMurphyASuarezCChatGPT and health care privacy risksJdsupra20232023-08-30https://www.jdsupra.com/legalnews/chatgpt-and-health

[4]

10.1177/2055207619871808

[5]

10.1136/amiajnl-2012-001500

[6]

10.1136/amiajnl-2012-000936

[7]

10.1109/ms.2013.99

[8]

10.2196/jmir.3973

[9]

Privacy in the age of medical big data

W. Nicholson Price, I. Glenn Cohen

Nature Medicine 10.1038/s41591-018-0272-7

[10]

10.1093/jamia/ocab012

[11]

10.2196/21747

[12]

ChatGPT cybersecurity risks and impactsNetTech20232023-08-30https://nettechconsultants.com/blog/chatgpt-cybersecurity-risks-and-impacts/

[13]

10.1016/j.isatra.2023.03.049

[14]

10.1016/j.jbusres.2023.113859

[15]

Drawbacks of Artificial Intelligence and Their Potential Solutions in the Healthcare Sector

Bangul khan, Hajira Fatima, Ayatullah Qureshi et al.

Biomedical Materials & Devices 10.1007/s44174-023-00063-2

[16]

SuraniADasSUnderstanding privacy and security postures of health care chatbots2022CHI'22April 30 - May 06New Orleans, LA

[17]

10.3390/app13116355

[18]

Introducing ChatGPTOpenAI2023-03-23https://openai.com/blog/chatgpt

[19]

GhaffarySThe makers of ChatGPT just released a new AI that can build websites, among other thingsVox2023-08-30https://www.vox.com/2023/3/15/23640640/gpt-4-chatgpt-openai-generative-ai

[20]

GPT-4 is OpenAI's most advanced systems, producing safer and more useful responsesOpenAI2023-03-23https://openai.com/product/gpt-4

[21]

Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study

Arya Rao, Michael Pang, John Kim et al.

Journal of Medical Internet Research 10.2196/48659

[22]

DilmeganiCGenerative AI healthcare industry: benefits, challenges, potentialsAIMultiple2023-08-30https://research.aimultiple.com/generative-ai-healthcare/

[23]

KochRChatGPT, AI, and the future of privacyProton2023-03-23https://proton.me/blog/privacy-and-chatgpt

[24]

OpenAI privacy policyOpenAI2023-03-23https://openai.com/policies/privacy-policy

[25]

McGowanEIs ChatGPT's use of people's data even legal?Avast20232023-03-23https://blog.avast.com/chatgpt-data-use-legal#:~:text=There%20is%20a%20legal%20basis,and%20right%20to%20data%20portability

[26]

CallahanCTo ban or not to ban: data privacy concerns around ChatGPTother AIWorklife20232023-03-23https://www.worklife.news/technology/chat-gpt-data/

[27]

HusromMUncovering the hidden risks of ChatGPT: keeping your data secureMedium20222023-03-23https://medium.com/nextray-ai/uncovering-the-hidden-risks-of-chatgpt-keeping-your-data-secure-99911f3ed777

[28]

LiuNIs ChatGPT a friend or foe to identity and access management?Cdxcentral20232023-03-23https://www.sdxcentral.com/articles/analysis/is-chatgpt-a-friend-or-foe-to-identity-and-access-management-chatgpt-weighs-in/2023/03/

[29]

McKeenJAI in health care presents need for security, privacy standards20222023-03-23https://healthitsecurity.com/features/ai-in-healthcare-presents-need-for-security-privacy-standards

Cited By

119

Biases in Artificial Intelligence Application in Pain Medicine

Oranicha Jumreornvong, Aliza Perez · 2025

Journal of Pain Research

Metrics

119

Citations

29

References

Details

Published: Nov 28, 2023
Vol/Issue: 25
Pages: e47551

Authors

J

Jingquan Li

National Key Laboratory for Swine Genetic Improvement and Germplasm Innovation, Ministry of Science and Technology of China, Jiangxi Agricultural University, Nanchang, China.

Cite This Article

Jingquan Li (2023). Security Implications of AI Chatbots in Health Care. Journal of Medical Internet Research, 25, e47551. https://doi.org/10.2196/47551

Security Implications of AI Chatbots in Health Care

You May Also Like