attention distillation

Ask and Remember: A Questions-Only Replay Strategy for Continual Visual Question Answering ICCV 2025 Attention Distillation: A Unified Approach to Visual Characteristics Transfer CVPR 2025 MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity AAAI 2025 VoCo-LLaMA: Towards Vision Compression with Large Language Models CVPR 2025 X2I: Seamless Integration of Multimodal Understanding into Diffusion Transformer via Attention Distillation ICCV 2025 Adapting Diffusion Models for Improved Prompt Compliance and Controllable Image Synthesis NeurIPS 2024 Generative Model-Based Feature Knowledge Distillation for Action Recognition AAAI 2024 SEEKR: Selective Attention-Guided Knowledge Retention for Continual Learning of Large Language Models EMNLP 2024 Training Graph Transformers via Curriculum-Enhanced Attention Distillation ICLR 2024 Unveiling the Magic: Investigating Attention Distillation in Retrieval-Augmented Generation NAACL 2024 Self-supervised Models are Good Teaching Assistants for Vision Transformers ICML 2022 Ensemble Attention Distillation for Privacy-Preserving Federated Learning ICCV 2021 Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networks ICLR 2021 Topic Scene Graph Generation by Attention Distillation From Caption ICCV 2021 Learning Without Memorizing CVPR 2019