الانتقال إلى المحتوى الرئيسي

اكتب مراجعة على PREreview

A Survey on Hallucination in Large Language and Foundation Models

نُشر
الخادم
Preprints.org
DOI
10.20944/preprints202504.1236.v1

Generative text models, particularly large language models (LLMs) and foundation models, have influenced numerous fields, including high-quality text generation, reasoning, and multimodal synthesis. These models have been widely applied in healthcare, legal analysis, and scientific research. However, where accuracy and reliability are critical, generative text models pose a significant risk due to hallucination, where generated outputs include incorrect factuality, fabricated, or misleading information. In this survey, we present a review of hallucination in generative AI, covering its taxonomy, detection methods, mitigation strategies, and evaluation benchmarks. We first establish a structured taxonomy, distinguishing between intrinsic vs. extrinsic hallucination and factual vs. semantic hallucination, also discussing task-specific variations in areas such as summarization, machine translation, and dialogue generation. Next, we examine state-of-the-art hallucination detection techniques, including uncertainty estimation, retrieval-augmented generation (RAG), self-consistency validation, and internal state monitoring. We further explore mitigation strategies, such as fine-tuning, reinforcement learning from human feedback (RLHF), knowledge injection, adversarial training, and contrastive learning. Additionally, we review key evaluation metrics and benchmarks, including FEVER, TruthfulQA, HALL-E, and Entity-Relationship-Based Hallucination Benchmarks (ERBench), which serve as standardized measures for assessing hallucination severity. Despite notable efforts, hallucination remains an open challenge, necessitating further improvements in real-time detection, multimodal hallucination evaluation, and trustworthiness frameworks. We show critical research gaps including the need for standardized hallucination taxonomies, scalable mitigation techniques, and human-AI hybrid verification methods. Our survey aims to serve as a foundational resource for researchers and practitioners, providing insights into current methodologies and guiding future advancements in trustworthy and explainable generative AI.

يمكنك كتابة مراجعة PREreview لـ A Survey on Hallucination in Large Language and Foundation Models. مراجعة PREreview هي مراجعة لمسودة بحثية أولية، ويمكن أن تتراوح بين بضع جمل وتقرير مطوّل، على غرار تقرير مراجعة الأقران الذي تنظمه المجلات العلمية.

قبل أن تبدأ

سنطلب منك تسجيل الدخول باستخدام معرّف ORCID الخاص بك. إذا لم يكن لديك معرّف، يمكنك إنشاء واحد.

ما هو معرّف ORCID؟

يُعدّ معرّف ORCID معرّفًا فريدًا يميّزك عن كل من يحمل اسمًا مطابقًا أو مشابهًا لاسمك.

ابدأ الآن