Knowledge Distillation

Why Does New Knowledge Create Messy Ripple Effects in LLMs? EMNLP 2024 Wired Perspectives: Multi-View Wire Art Embraces Generative AI CVPR 2024 xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metrics EMNLP 2024 XKD: Cross-Modal Knowledge Distillation with Domain Alignment for Video Representation Learning AAAI 2024 Your Student is Better Than Expected: Adaptive Teacher-Student Collaboration for Text-Conditional Diffusion Models CVPR 2024 ZeroFlow: Scalable Scene Flow via Distillation ICLR 2024 3DAvatarGAN: Bridging Domains for Personalized Editable Avatars CVPR 2023 3D Segmenter: 3D Transformer based Semantic Segmentation via 2D Panoramic Distillation ICLR 2023 ABC-KD: Attention-Based-Compression Knowledge Distillation for Deep Learning-Based Noise Suppression Interspeech 2023 Accelerating Molecular Graph Neural Networks via Knowledge Distillation NeurIPS 2023 Accelerating Multiple Intent Detection and Slot Filling via Targeted Knowledge Distillation EMNLP 2023 Accurate and Structured Pruning for Efficient Automatic Speech Recognition Interspeech 2023 A Comparative Analysis of Task-Agnostic Distillation Methods for Compressing Transformer Language Models EMNLP 2023 Acoustic NLOS Imaging with Cross Modal Knowledge Distillation IJCAI 2023 AdapterDistillation: Non-Destructive Task Composition with Knowledge Distillation EMNLP 2023 Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning EMNLP 2023 Adapter-TST: A Parameter Efficient Method for Multiple-Attribute Text Style Transfer EMNLP 2023 Adapting Shortcut With Normalizing Flow: An Efficient Tuning Framework for Visual Recognition CVPR 2023 Adaptive Contrastive Knowledge Distillation for BERT Compression ACL 2023 Adaptive Data-Free Quantization CVPR 2023 Adaptive Hierarchy-Branch Fusion for Online Knowledge Distillation AAAI 2023 Adaptive Mixing of Auxiliary Losses in Supervised Learning AAAI 2023 AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression ACL 2023 ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation CoRL 2023 Adversarial Finetuning with Latent Representation Constraint to Mitigate Accuracy-Robustness Tradeoff ICCV 2023