conftrace_

attention transfer

11 papers

Explore in graph

Also known as

AT

Co-occurring keywords · papers mentioning both

knowledge distillation (6) attention mechanism (3) model compression (3) domain adaptation (2) incremental speech recognition (1) language-based colorization (1) color-object decoupled condition (1) object-color corresponding matrix (1) attention transfer module (1) soft-gated injection module (1)

Papers

LoLCATs: On Low-Rank Linearizing of Large Language Models ICLR 2025 On the Surprising Effectiveness of Attention Transfer for Vision Transformers NeurIPS 2024 AttTrack: Online Deep Attention Transfer for Multi-Object Tracking WACV 2023 Goal-Conditioned Q-learning as Knowledge Distillation AAAI 2023 How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives ACL 2023 L-CoDe:Language-Based Colorization Using Color-Object Decoupled Conditions AAAI 2022 Multi-View Attention Transfer for Efficient Speech Enhancement Interspeech 2022 Attention Transfer Network for Aspect-level Sentiment Classification COLING 2020 Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting CVPR 2019 Multi-Source Weak Supervision for Saliency Detection CVPR 2019 Sequence-to-Sequence Learning via Attention Transfer for Incremental Speech Recognition Interspeech 2019