Evolving Graph-Based Context Modeling for Multi-Turn Conversational Retrieval-Augmented Generation

Abstract

Conversational Retrieval-Augmented Generation (RAG) systems enhance user interactions by integrating large language models (LLMs) with external knowledge retrieval. However, multi-turn conversations present significant challenges, including implicit user intent and noisy context, which hinder accurate retrieval and response generation. Existing approaches often struggle with the unstructured conversational context and fail to model explicit relations among conversational turns. Moreover, they do not leverage historically relevant passages effectively. To overcome these limitations, we propose EvoRAG, a novel framework that maintains an evolving knowledge graph aligned with the unstructured conversational context. This graph explicitly captures relations among user queries, system responses, and relevant passages across conversational turns, serving as a structured representation of the context. EvoRAG includes three key components: (1) a dual-path retrieval module for context denoising, (2) a unified knowledge integration module for query rewriting and summarization, and (3) a graph-enhanced RAG module for accurate retrieval and response generation. Experiments on four public conversational RAG datasets show that EvoRAG significantly outperforms strong baselines, particularly in handling topic shifts and long dialogue contexts.