A Hybrid Framework for Detecting Hallucinations in Large Language Model Outputs
- Title
- A Hybrid Framework for Detecting Hallucinations in Large Language Model Outputs
- Creator
- Bajaj, Manav M.; Senthil Vadivu, M.; Jeevanand, E.S.
- Description
- With Large Language Models (LLMs) continuously growing, they are on a path to replace the search engines soon. No matter how powerful they get, there is a certain level of uncertainty because they tend to hallucinate. Hallucination here refers to generate factually incorrect data, this can include making up names, generating false links and fabricating stories. This makes it extremely difficult to trust large language models. Existing papers provide solutions which are either not monetarily feasible or lack capabilities to build a robust hallucination detector. This paper aims to build a low resource hallucination detector which combines multiple heuristic signals like semantic similarity, self-consistency, external grounding via Wikipedia, NER overlap, flexible numerical check and a quantized LLM Falcon-7b. This eliminates the need to train the model from scratch. Upon evaluating with an input dataset of 50 questions the model was able to achieve an accuracy of 88%. 2025 IEEE.
- Source
- 4th International Conference on Applied Artificial Intelligence and Computing, ICAAIC 2025;pp.1028-1034
- Date
- 01-01-2025
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Subject
- Hallucination Detection; Heuristic Analysis; Large Language Models (LLMs); Low-Resource AI; Self-Consistency
- Coverage
- Bajaj M.M., Christ (Deemed to be University), Bangalore, India; Senthil Vadivu M., Christ (Deemed to be University), Dept. of Statistics and Data Science, Bangalore, India; Jeevanand E.S., Christ (Deemed to be University), Dept. of Statistics and Data Science, Bangalore, India
- Rights
- Restricted Access; Hardcopy may be available in the library
- Relation
- ISBN: 979-833156587-9;
- Format
- online
- Language
- English
- Type
- Conference paper
Collection
Citation
Bajaj, Manav M.; Senthil Vadivu, M.; Jeevanand, E.S., “A Hybrid Framework for Detecting Hallucinations in Large Language Model Outputs,” CHRIST (Deemed To Be University) Institutional Repository, accessed June 18, 2026, https://archives.christuniversity.in/items/show/25891.
