AI Hallucinations in Information Security : A Bibliometric and Grounded Study Perspective
محتوى المقال
الملخص
The ubiquitous use of artificial intelligence (AI) and generative models across multiple sectors such as healthcare, finance, education, and cybersecurity, have given rise to what is now commonly termed ‘AI hallucinations’, that is, these models become more sophisticated but prone to producing outputs that are factually incorrect, nonsensical, or misleading, despite their seemingly authoritative tone. AI hallucinations pose significant risks to information security by undermining data integrity, eroding trust, and providing fertile ground for malicious exploitation. This paper uses a dual-mixed method approach that provides both macro-level trends via bibliometrics and micro-level contextual understanding via qualitative methods on how AI hallucinations impact information security. 322 peer-reviewed articles, conference papers, and book chapters retrieved from the Scopus database were the impetus for a bibliometrics study, while four information security practitioners provided data for a qualitative inquiry and theory formulation. By synthesizing insights from interdisciplinary studies in computer science, cognitive psychology, and ethics, and using a grounded theory approach, we outline how practitioners perceive AI hallucinations in practice and the contextual challenges they face. Through a grounded theory method (GTM) approach, key categories were identified, which enabled a better understanding of AI hallucinations. These categories include AI Usage Patterns, Confidence & Familiarity, Verification Strategies, Trust & Hallucination Triggers, and Tone & Believability, and point to how AI hallucinations are understood and interpreted by information security practitioners.
الكلمات المفتاحية
Hallucinations، Bibliometric Analysis، information security
التنزيلات
المراجع
Ajuzieogu, Uchechukwu C, Towards Hallucination-Resilient AI: Navigating Challenges, Ethical Dilemmas, and Mitigation Strategies. 2024.
Brameier, D.T., et al., Artificial intelligence in orthopaedic surgery: Can a large language model “write” a believable orthopaedic journal article? JBJS, 2023. 105(17): p. 1388-1392.
Williamson, S.M. and V. Prybutok, The era of artificial intelligence deception: Unraveling the complexities of false realities and emerging threats of misinformation. Information, 2024. 15(6): p. 299.
Bruno, A., et al., Insights into Classifying and Mitigating LLMs' Hallucinations. arXiv preprint arXiv:2311.08117, 2023.
Maleki, N., B. Padmanabhan, and K. Dutta. AI hallucinations: a misnomer worth clarifying. in 2024 IEEE conference on artificial intelligence (CAI). 2024. IEEE.
Hatem, R., B. Simmons, and J.E. Thornton, A call to address AI “hallucinations” and how healthcare professionals can mitigate their risks. Cureus, 2023. 15(9).
Banerjee, S., A. Agarwal, and S. Singla, Llms will always hallucinate, and we need to live with this. arXiv preprint arXiv:2409.05746, 2024.
Lee, W., How to identify emerging research fields using scientometrics: An example in the field of Information Security. Scientometrics, 2008. 76(3): p. 503-525.
Werner, M.J. and K. Njenga. Phishing Attack Victims and the Effect on Work Engagement. in International Development Informatics Association Conference. 2022. Springer.
Barrett, C., et al., Identifying and mitigating the security risks of generative ai. Foundations and Trends® in Privacy and Security, 2023. 6(1): p. 1-52.
Kaur, H., et al. Evolution of endpoint detection and response (edr) in cyber security: A comprehensive review. in E3S Web of Conferences. 2024. EDP Sciences.
Gondode, P., S. Duggal, and V. Mahor, Artificial intelligence hallucinations in anaesthesia: Causes, consequences and countermeasures. Indian Journal of Anaesthesia, 2024. 68(7): p. 658-661.
Ejeofobiri, C., et al., al The role of Artificial Intelligence in enhancing cybersecurity: A comprehensive review of threat detection, response, and prevention techniques. International Journal of Science and Research Archive, 2024. 13(02): p. 310-316.
Ahmadi, A., Unravelling the mysteries of hallucination in large language models: strategies for precision in artificial intelligence language generation. Asian Journal of Computer Science and Technology, 2024. 13(1): p. 1-10.
Tornero-Costa, R., et al., Methodological and quality flaws in the use of artificial intelligence in mental health research: systematic review. JMIR Mental Health, 2023. 10(1): p. e42045.
Liang, X., et al., Internal consistency and self-feedback in large language models: A survey. arXiv preprint arXiv:2407.14507, 2024.
Bhagat, S.V. and D. Kanyal, Navigating the future: the transformative impact of artificial intelligence on hospital management-a comprehensive review. Cureus, 2024. 16(2).
Strauss, A. and J. Corbin, Basics of qualitative research techniques. 1998.
Corbin, J. and A. Strauss, Basics of qualitative research: Techniques and procedures for developing grounded theory. 2014: Sage publications.
Song, Y., et al., Exploring two decades of research on classroom dialogue by using bibliometric analysis. Computers & Education, 2019. 137: p. 12-31.
Aria, M. and C. Cuccurullo, bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of informetrics, 2017. 11(4): p. 959-975.
Mohamed, N., Current trends in AI and ML for cybersecurity: A state-of-the-art survey. Cogent Engineering, 2023. 10(2): p. 2272358.
Sood, P., et al., Review the role of artificial intelligence in detecting and preventing financial fraud using natural language processing. International Journal of System Assurance Engineering and Management, 2023. 14(6): p. 2120-2135.
Robledo-Giraldo, S., et al., Mapping, evolution, and application trends in co-citation analysis: a scientometric approach. Revista de Investigación, Desarrollo e Innovación, 2023. 13(1): p. 201-214.
Kumar, S., Co-authorship networks: a review of the literature. Aslib Journal of Information Management, 2015. 67(1): p. 55-73.
Bassett, A.S., A. Bury, and W.G. Honer, Testing Liddle's three-syndrome model in families with schizophrenia. Schizophrenia Research, 1994. 12(3): p. 213-221.
Ter Meulen, B., D. Tavy, and B. Jacobs, From stroboscope to dream machine: a history of flicker-induced hallucinations. European neurology, 2009. 62(5): p. 316-320.
Miller, B.L. and B.F. Boeve, The behavioral neurology of dementia. 2009: Cambridge University Press.
Maynez, J., et al., On faithfulness and factuality in abstractive summarization. arXiv preprint arXiv:2005.00661, 2020.
Cao, M., Y. Dong, and J.C.K. Cheung, Hallucinated but factual! inspecting the factuality of hallucinations in abstractive summarization. arXiv preprint arXiv:2109.09784, 2021.
Li, J., et al., Halueval: A large-scale hallucination evaluation benchmark for large language models. arXiv preprint arXiv:2305.11747, 2023.
Rao, A., et al., Assessing the utility of ChatGPT throughout the entire clinical workflow: development and usability study. Journal of Medical Internet Research, 2023. 25: p. e48659.
Balachandran, V., et al., Correcting diverse factual errors in abstractive summarization via post-editing and language model infilling. arXiv preprint arXiv:2210.12378, 2022.
Hicks, M.T., J. Humphries, and J. Slater, ChatGPT is bullshit. Ethics and Information Technology, 2024. 26(2): p. 1-10.
Beutel, G., E. Geerits, and J.T. Kielstein, Artificial hallucination: GPT on LSD? Critical Care, 2023. 27(1): p. 148.
Li, B., et al., Trustworthy AI: From principles to practices. ACM Computing Surveys, 2023. 55(9): p. 1-46.
Gao, Y., et al. AIGCs confuse AI too: Investigating and explaining synthetic image-induced hallucinations in large vision-language models. in Proceedings of the 32nd ACM International Conference on Multimedia. 2024.
Urquhart, C., An encounter with grounded theory: Tackling the practical and philosophical issues, in Qualitative research in IS: Issues and trends. 2001, IGI Global Scientific Publishing. p. 104-140.
Erdem, S. and A. Pamuk, The Use of ChatGPT in Qualitative Data Analysis: A Comparative Analysis on Contextual Fidelity and Thematic Consistency. International Journal of Field Education, 2025. 11(2): p. 28-57.
Carchiolo, V. and M. Malgeri, Trends, Challenges, and Applications of Large Language Models in Healthcare: A Bibliometric and Scoping Review. Future Internet, 2025. 17(2): p. 76.
Su, H., et al., Large Language Models in Medical Diagnostics: Scoping Review With Bibliometric Analysis. Journal of Medical Internet Research, 2025. 27: p. e72062.
Leschanowsky, A., et al., Evaluating privacy, security, and trust perceptions in conversational AI: A systematic review. arXiv preprint arXiv:2406.09037, 2024
تفاصيل المقال
هذا العمل مرخص بموجب Creative Commons Attribution-NonCommercial 4.0 International License.