Skip to content
conftrace_

knowledge distillation

4,137 papers

KD

Papers

Anomaly Detection in Video via Self-Supervised and Multi-Task Learning CVPR 2021 An Overview of Uncertainty Calibration for Text Classification and the Role of Distillation ACL 2021 Anycost GANs for Interactive Image Synthesis and Editing CVPR 2021 Anytime Inference with Distilled Hierarchical Neural Ensembles AAAI 2021 A Peek Into the Reasoning of Neural Networks: Interpreting With Structural Visual Concepts CVPR 2021 Arabic Compact Language Modelling for Resource Limited Devices EACL 2021 A Realistic Evaluation of Semi-Supervised Learning for Fine-Grained Classification CVPR 2021 A Simple and Effective Self-Supervised Contrastive Learning Framework for Aspect Detection AAAI 2021 A statistical perspective on distillation ICML 2021 A Student-Teacher Architecture for Dialog Domain Adaptation Under the Meta-Learning Setting AAAI 2021 Asynchronous Teacher Guided Bit-wise Hard Mining for Online Hashing AAAI 2021 A teacher-student framework to distill future trajectories ICLR 2021 AttentiveNAS: Improving Neural Architecture Search via Attentive Sampling CVPR 2021 Audio-Oriented Multimodal Machine Comprehension via Dynamic Inter- and Intra-modality Attention AAAI 2021 Automatic ICD Coding via Interactive Shared Representation Networks with Self-distillation Mechanism ACL 2021 Automatic Mixed-Precision Quantization Search of BERT IJCAI 2021 AutoReCon: Neural Architecture Search-based Reconstruction for Data-free Compression IJCAI 2021 AUTOSUMM: Automatic Model Creation for Text Summarization EMNLP 2021 AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models ACL 2021 BART-TL: Weakly-Supervised Topic Label Generation EACL 2021 BERTAC: Enhancing Transformer-based Language Models with Adversarially Pretrained Convolutional Neural Networks ACL 2021 Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference EMNLP 2021 Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression EMNLP 2021 BinaryBERT: Pushing the Limit of BERT Quantization ACL 2021 Block Pruning For Faster Transformers EMNLP 2021