AI hallucination: towards a comprehensive classification of distorted information in artificial intelligence-generated content

Yujie Sun; Dongfang Sheng; Zihan Zhou; Yifei Wu

doi:10.1057/s41599-024-03811-x

journal article Open Access Sep 27, 2024

AI hallucination: towards a comprehensive classification of distorted information in artificial intelligence-generated content

Yujie Sun

Dongfang Sheng Zihan Zhou

Yifei Wu

Humanities and Social Sciences Communications Vol. 11 No. 1 · Springer Science and Business Media LLC

View at Publisher Save 10.1057/s41599-024-03811-x

Topics

No keywords indexed for this article. Browse by subject →

References

53

[1]

Abdulrahman E, Abdelrahim F, Fathi M, Firass A, Ali K (2023) ChatGPT and the rise of semi-humans. Humanit Soc Sci Commun 10(1):626. https://doi.org/10.1057/s41599-023-02154-3 10.1057/s41599-023-02154-3

[2]

Fake News Detection Using Machine Learning Ensemble Methods

Iftikhar Ahmad, Muhammad Yousaf, Suhail Yousaf

Complexity 2020 10.1155/2020/8885861

[3]

Anastasiei I, Georgescu M (2020) Automated vs Manual Content Analysis – A Retrospective Look. Sci Ann Econ Bus 67:57–67. https://doi.org/10.47743/saeb-2020-0025 10.47743/saeb-2020-0025

[4]

Bašić Ž, Banovac A, Kružić I, Jerković I (2023) ChatGPT-3.5 as writing assistance in students’ essays. Humanit Soc Sci Commun 10(1):750. https://doi.org/10.1057/s41599-023-02269-7 10.1057/s41599-023-02269-7

[5]

Bastos J, Faerstein E (2012) Conceptual and methodological aspects of relations between discrimination and health in epidemiological studies. Cad de Saúde Pública 28(1):177–183. https://doi.org/10.1590/s0102-311x2012000100019 10.1590/s0102-311x2012000100019

[6]

Berelson B (1952) Content analysis in communication research. Glencoe, Scotland

[7]

Boettger R, Palmer L (2010) Quantitative Content Analysis: Its Use in Technical Communication. IEEE Trans Professional Commun 53(4):346–357. https://doi.org/10.1109/TPC.2010.2077450 10.1109/tpc.2010.2077450

[8]

Borji A (2023) A Categorical Archive of ChatGPT Failures. arXiv. http://arxiv.org/abs/2302.03494 10.21203/rs.3.rs-2895792/v1

[9]

Brady W, Crockett M, Van Bavel J (2020) The MAD Model of Moral Contagion: The Role of Motivation, Attention, and Design in the Spread of Moralized Content Online. Perspect Psychol Sci 15(4):978–1010. https://doi.org/10.1177/1745691620917336 10.1177/1745691620917336

[10]

CAICT (2019) Artificial Intelligence Generated Content (AIGC) White Paper (2022) http://www.caict.ac.cn/kxyj/qwfb/bps/202209/t20220902_408420.htm. Accessed 25 Dec 2023

[11]

Cappellani F, Card K, Shields C, Pulido J, Haller J (2024) Reliability and accuracy of artificial intelligence ChatGPT in providing information on ophthalmic diseases and management to patients. EYE. https://doi.org/10.1038/s41433-023-02906-0 10.1038/s41433-023-02906-0

[12]

Carrasco-Farré C (2022) The fingerprints of misinformation: How deceptive content differs from reliable sources in terms of cognitive effort and appeal to emotions. Humanit Soc Sci Commun 9(1):162. https://doi.org/10.1057/s41599-022-01174-9 10.1057/s41599-022-01174-9

[13]

Casero-Ripollés A, Tuñón J, Bouza-García L (2023) The European approach to online disinformation: Geopolitical and regulatory dissonance. Humanit Soc Sci Commun 10(1):657. https://doi.org/10.1057/s41599-023-02179-8 10.1057/s41599-023-02179-8

[14]

Chen M (2023) A meta-analysis of third-person perception related to distorted information: Synthesizing the effect, antecedents, and consequences. Information Processing and Management. https://doi.org/10.1016/j.ipm.2023.103425 10.1016/j.ipm.2023.103425

[15]

Chiplot (2024) Classification bar chart. https://www.chiplot.online/.Accessed 25 Jun 2024

[16]

Christensen J (2024) Understanding the role and impact of Generative Artificial Intelligence (AI) hallucination within consumers’ tourism decision-making processes.Curr Issues in Tourism. https://doi.org/10.1080/13683500.2023.2300032 10.1080/13683500.2023.2300032

[17]

Dragomir M, Rúas-Araújo J, Horowitz M (2024) Beyond online disinformation: Assessing national information resilience in four European countries. Humanit Soc Sci Commun 11(1):1–10. https://doi.org/10.1057/s41599-024-02605-5 10.1057/s41599-024-02605-5

[18]

The qualitative content analysis process

Satu Elo, Helvi Kyngäs

Journal of Advanced Nursing 2008 10.1111/j.1365-2648.2007.04569.x

[19]

Fang S, Tang Q (2023) Typological analysis of ChatGPT error content generation. News and Writing. https://www.cnki.net/

[20]

GitHub (2023) LLM failure archive. https://github.com/giuven95/chatgpt-failures#llm-failure-archive-chatgpt-and-beyond.Accessed 25 Dec 2023

[21]

Huang H (2023) Performance of ChatGPT on Registered Nurse License Exam in Taiwan: A Descriptive Study. Healthcare 11(21):2855. https://doi.org/10.3390/healthcare11212855 10.3390/healthcare11212855

[22]

Huanqi (2023) A fake picture causes stock market turmoil! AI “mischief” continues to appear, and countries have tightened supervision. https://www.huanqiu.com/article/4D2o3i2dY8w.Accessed 25 Dec 2023

[23]

James P, Howard N, Henrik A, Alicia F (2018) Countering Information Influence Activities : The State of the Art. MSB. https://www.msb.se/RibData/Filer/pdf/28697.pdf

[24]

Survey of Hallucination in Natural Language Generation

Ziwei Ji, Nayeon Lee, Rita Frieske et al.

ACM Computing Surveys 2023 10.1145/3571730

[25]

Kapantai E, Christopoulou A, Berberidis C, Peristeras V (2021) A systematic literature review on disinformation: Toward a unified taxonomical framework. N. Media Soc 23(5):1301–1326. https://doi.org/10.1177/1461444820959296 10.1177/1461444820959296

[26]

Demystifying Content Analysis

A.J. Kleinheksel, Nicole Rockich-Winston, Huda Tawfik et al.

American Journal of Pharmaceutical Education 10.5688/ajpe7113

[27]

Komendantova N, Ekenberg L, Svahn M, Larsson A, Shah S, Glinos M, Koulolias V, Danielson M (2021) A value-driven approach to addressing misinformation in social media. Humanit Soc Sci Commun 8(1):1–12. https://doi.org/10.1057/s41599-020-00702-9 10.1057/s41599-020-00702-9

[28]

Koubaa A, Boulila W, Alzahem A, Latif S (2023) Exploring ChatGPT Capabilities and Limitations: A Survey. IEEE Access 11:118698–118721. https://doi.org/10.1109/ACCESS.2023.3326474 10.1109/access.2023.3326474

[29]

Kumar M, Mani U, Tripathi P, Saalim M, Roy S, Kumar M, Mani U, Tripathi P, Saalim M, Sr S (2023) Artificial Hallucinations by Google Bard: Think Before You Leap. Cureus J Med Sci 15(8). https://doi.org/10.7759/cureus.43313 10.7759/cureus.43313

[30]

Lee L, Dabirian A, McCarthy I, Kietzmann J (2020) Making sense of text: Artificial intelligence-enabled content analysis. Eur J Mark 54(3):615–644. https://doi.org/10.1108/EJM-02-2019-0219 10.1108/ejm-02-2019-0219

[31]

Lee M (2023) A Mathematical Investigation of Hallucination and Creativity in GPT Models. Mathematics 11(10):10. https://doi.org/10.3390/math11102320 10.3390/math11102320

[32]

Liu H, Xue W, Chen Y, Chen D, Zhao X, Wang K, Hou L, Li R, Peng W (2024) A Survey on Hallucination in Large Vision-Language Models. arXiv. http://arxiv.org/abs/2402.00253

[33]

Liu Y, Jacoby R, Jang H, Li D (2019) A Content Analysis of Adoption Articles in Counseling Journals: A 30-Year Review. Fam J 27(1):67–74. https://doi.org/10.1177/1066480718809424 10.1177/1066480718809424

[34]

A Study on Factors Influencing Designers’ Behavioral Intention in Using AI-Generated Content for Assisted Design: Perceived Anxiety, Perceived Risk, and UTAUT

Weiyi Li

International Journal of Human–Computer Interactio... 10.1080/10447318.2024.2310354

[35]

Monteith S, Glenn T, Geddes J, Whybrow P, Achtyes E, Bauer M (2024) Artificial intelligence and increasing misinformation. Br J Psychiatry 224(2):33–35. https://doi.org/10.1192/bjp.2023.136 10.1192/bjp.2023.136

[36]

Mo Z, Pang D, Liu H, Zhao Y (2023) Analysis on AIGC False Information Problem and Root Cause from the Perspective of Information Quality. Documentation,Inf Knowl 40(4):32–40. https://link.cnki.net/doi/10.13366/j.dik.2023.04.032

[37]

NewsGuard (2023) Transparent Reliability Ratings for News and Information Sources. https://www.newsguardtech.com/.Accessed 25 Dec 2023

[38]

OpenAI (2023) GPT-4. https://openai.com/research/gpt-4.Accessed 25 Jan 2024

[39]

Polyportis A, Pahos N (2024) Navigating the perils of artificial intelligence: A focused review on ChatGPT and responsible research and innovation. Humanit Soc Sci Commun 11(1):1–10. https://doi.org/10.1057/s41599-023-02464-6 10.1057/s41599-023-02464-6

[40]

Rawte V, Chakraborty S, Pathak A, Sarkar A (2023) The Troubling Emergence of Hallucination in Large Language Models – An Extensive Definition, Quantification, and Prescriptive Remediations. arXiv. https://doi.org/10.48550/arXiv.2310.04988 10.48550/arxiv.2310.04988

[41]

Rivas P, Zhao L (2023) Marketing with ChatGPT: Navigating the Ethical Terrain of GPT-Based Chatbot Technology. AI 4(2):375–384. https://doi.org/10.3390/ai4020019 10.3390/ai4020019

[42]

Roozenbeek J, Van Der Linden S, Goldberg B, Rathje S, Lewandowsky S (2022) Psychological inoculation improves resilience against misinformation on social media. Sci Adv 8(34):6254. https://doi.org/10.1126/sciadv.abo6254 10.1126/sciadv.abo6254

[43]

Salaverría R, Cardoso G (2023) Future of disinformation studies: Emerging research fields. El Profesional de La Información. https://doi.org/10.3145/epi.2023.sep.25 10.3145/epi.2023.sep.25

[44]

Shao L, Chen B, Zhang Z, Zhang Z, Chen X (2024) Artificial intelligence generated content (AIGC) in medicine: A narrative review. Math Biosci Eng 21(1):1672–1711. https://doi.org/10.3934/mbe.2024073 10.3934/mbe.2024073

[45]

Suarez-Lledo V, Alvarez-Galvez J (2021) Prevalence of Health Misinformation on Social Media: Systematic Review. J Med Internet Res 23(1):e17187. https://doi.org/10.2196/17187 10.2196/17187

[46]

Typeform (2023) ChatGPT/LLM Errors Tracker. https://researchrabbit.typeform.com/llmerrors.Accessed 25 Dec 2023

[47]

Walters W, Wilder E (2023) Fabrication and errors in the bibliographic citations generated by ChatGPT. Sci Rep 13(1) https://doi.org/10.1038/s41598-023-41032-5 10.1038/s41598-023-41032-5

[48]

Wang Y, Pan Y, Yan M, Su Z, Luan T (2023) A Survey on ChatGPT: AI–Generated Contents, Challenges, and Solutions. IEEE Open J Computer Soc 4:280–302. https://doi.org/10.1109/OJCS.2023.3300321 10.1109/ojcs.2023.3300321

[49]

Content Analysis: A Flexible Methodology

Marilyn Domas White, Emily E Marsh

Library Trends 2006 10.1353/lib.2006.0053

[50]

Social media and vaccine hesitancy

Steven Lloyd Wilson, Charles Wiysonge

BMJ Global Health 2020 10.1136/bmjgh-2020-004206

Showing 50 of 53 references

Cited By

174

Evolutionary Game Analysis of AI-Generated Disinformation Governance on UGC Platforms Based on Prospect Theory

Licai Lei, Yanyan Wu · 2026

Systems

‘AI lost the prompt!’ Replacing ‘AI hallucination’ to distinguish between mere errors and irregularities

José María Ariso, Peter Bannister · 2025

AI & SOCIETY

Conceptual and formal models for design, adaptation, and control of digital twins in supply chain ecosystems

Dmitry Ivanov · 2025

Omega

Metrics

174

Citations

53

References

Details

Published: Sep 27, 2024
Vol/Issue: 11(1)
License: View

Authors

Y

Yujie Sun

State Key Laboratory of Biomembrane and Membrane Biotechnology, Biodynamic Optical Imaging Center (BIOPIC), School of Life Sciences, Peking University, Beijing 100871, China

Princeton University

Technology R&D Department Fujian Longking Co., Ltd. Longyan 364000 China

Cite This Article

Yujie Sun, Dongfang Sheng, Zihan Zhou, et al. (2024). AI hallucination: towards a comprehensive classification of distorted information in artificial intelligence-generated content. Humanities and Social Sciences Communications, 11(1). https://doi.org/10.1057/s41599-024-03811-x

AI hallucination: towards a comprehensive classification of distorted information in artificial intelligence-generated content

You May Also Like