conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

I2D2: Inductive Knowledge Distillation with NeuroLogic and Self-Imitation ACL 2023
Dataset Distillation with Attention Labels for Fine-tuning BERT ACL 2023
Self-Distilled Quantization: Achieving High Compression Rates in Transformer-Based Language Models ACL 2023
CUPID: Curriculum Learning Based Real-Time Prediction using Distillation ACL 2023
PruMUX: Augmenting Data Multiplexing with Model Compression ACL 2023
Enabling Classifiers to Make Judgements Explicitly Aligned with Human Values ACL 2023
Recyclable Tuning for Continual Pre-training ACL 2023
An Empirical Analysis of Leveraging Knowledge for Low-Resource Task-Oriented Semantic Parsing ACL 2023
KG-FLIP: Knowledge-guided Fashion-domain Language-Image Pre-training for E-commerce ACL 2023
Query Enhanced Knowledge-Intensive Conversation via Unsupervised Joint Modeling ACL 2023
Analyzing and Reducing the Performance Gap in Cross-Lingual Transfer with Fine-tuning Slow and Fast ACL 2023
PuMer: Pruning and Merging Tokens for Efficient Vision Language Models ACL 2023
Towards Fewer Hallucinations in Knowledge-Grounded Dialogue Generation via Augmentative and Contrastive Knowledge-Dialogue ACL 2023
Commonsense Knowledge Transfer for Pre-trained Language Models ACL 2023
Learning from a Friend: Improving Event Extraction via Self-Training with Feedback from Abstract Meaning Representation ACL 2023
HuaSLIM: Human Attention Motivated Shortcut Learning Identification and Mitigation for Large Language models ACL 2023
itKD: Interchange Transfer-Based Knowledge Distillation for 3D Object Detection CVPR 2023
TinyMIM: An Empirical Study of Distilling MIM Pre-Trained Models CVPR 2023
Boost Vision Transformer With GPU-Friendly Sparsity and Quantization CVPR 2023
SCPNet: Semantic Scene Completion on Point Cloud CVPR 2023
Distilling Vision-Language Pre-Training To Collaborate With Weakly-Supervised Temporal Action Localization CVPR 2023
DaFKD: Domain-Aware Federated Knowledge Distillation CVPR 2023
MMANet: Margin-Aware Distillation and Modality-Aware Regularization for Incomplete Multimodal Learning CVPR 2023
Preserving Linear Separability in Continual Learning by Backward Feature Projection CVPR 2023
3DAvatarGAN: Bridging Domains for Personalized Editable Avatars CVPR 2023