LOKA: Conflict-Aware LLM Knowledge Update with Adaptive Knowledge Memory
LOKA introduces conflict-aware LLM knowledge updates using adaptive multi-unit memory with learned routing, improving accuracy and flexibility over separate unlearning and learning methods.
Published 2026Paper ↗
Only vote on papers you've read. Sign in with GitHub to vote.
LOKA delivers a genuinely conflict-aware knowledge update framework through adaptive multi-unit memory and selective routing that outperforms split methods at scale, though its theoretical validation and adaptive allocation criteria remain underspecified.
Abstract
Large Language Models (LLMs) have achieved remarkable success in natural language processing by encoding extensive knowledge, but their utility relies on timely updates as human knowledge keeps evolving.In this paper, we investigate the problem of LLM knowledge updates, which requires simultaneously unlearning unwanted information and learning new knowledge.Existing approaches that tackle unlearning and learning separately encounter task conflicts and knowledge management issues when applied to comprehensive knowledge updates.In this paper, we validate our findings with theoretical analysis and empirical evidence, and propose LOKA, a conflict-aware framework for Large language mOdel Knowledge updAtes.During training, LOKA introduces an adaptive knowledge memory approach in which updated knowledge is allocated across multiple memory units.During inference, LOKA retrieves the most relevant memory unit from the knowledge memory and integrates it with the original LLM to apply updated knowledge, while a learning-based router controls the activation of the knowledge memory to improve knowledge utilization.Extensive experiments demonstrate the efficacy of LOKA in achieving accurate, flexible, and conflict-aware knowledge updates.