Skip to content
conftrace_
2026 EMNLP EMNLP 2026

Forgetting Across Modalities: Unlearning in Multimodal Large Language Models

AbstractGradient conflict between forgetting and retaining objectives is a well-known obstacle in machine unlearning, where opposing gradients on shared parameters cause destructive interference. In Multimodal Large Language Models (MLLMs), cross-modal coupling entangles visual and textual representations within the same parameters, making this conflict considerably more severe. We propose EASE (Efficient Alignment-aware Selective Erasing), which explicitly balances the conflicting gradient directions. EASE first dynamically locates the conflicting parameters at each step by detecting opposite-sign gradients, then performs a manifold-constrained optimization within the two-dimensional subspace spanned by the task gradients to find the linear combination that maximally aligns them, yielding a valid descent direction for both objectives without any manually tuned trade-off coefficient. Nonconflicting parameters keep their standard updates, keeping the method lightweight. Experiments across multiple MLLM architectures and unlearning benchmarks show that EASE achieves superior unlearning efficiency and faster convergence while matching or surpassing existing methods in multimodal quality.

More from EMNLP 2026

All EMNLP 2026 papers →