An automatic method to estimate correctness of RAG
This method predicts the correctness of retrieval-augmented generation by analyzing uncertainty.
In sectors in where data quality is critical, like finance and healthcare, it is crucial to have confidence in not only the outputs generated by retrieval-augmented generation (RAG) models but also the process followed by the model while arriving at the output. Existing methods, such as hallucination detection and input-output entailment measurements, fail to capture the model’s internal state during answer generation. This paper introduces a novel approach to predict the correctness of the generated answer by modeling the model’s uncertainty on quantified perturbations of input. Extensive experiments across multiple large language models (LLMs) demonstrate that our approach quantifies RAG robustness by aligning predictions with ground truth with a Avg. Mean Square Error (MSE) 0.002 while offering flexibility for diverse qualitative metrics.
Latest publications
RECAP: Regression evaluation for continual adaptation of prompts
A benchmark that measures continual-learning phenomena at the constraint level for prompt-level adaptation methods.
EMNLPMEMGUARD: Preventing memory contamination in long-term memory-augmented large language models
A type-aware memory framework that preserves functional memory boundaries during memory construction and retrieval.
EMNLPA history-aware visually grounded critic for computer use agents
A test time intervention framework for long-horizon GUI agents.
EMNLP