conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

An Efficient Combinatorial Optimization Model Using Learning-to-Rank Distillation AAAI 2022
Rethinking Resolution in the Context of Efficient Video Recognition NIPS 2022
A Fast Post-Training Pruning Framework for Transformers NIPS 2022
Ensemble Transformer for Efficient and Accurate Ranking Tasks: an Application to Question Answering Systems EMNLP 2022
From Fully Trained to Fully Random Embeddings: Improving Neural Machine Translation with Compact Word Embedding Tables AAAI 2022
Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models NIPS 2022
Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts NIPS 2022
Fairness without Demographics through Knowledge Distillation NIPS 2022
SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Training NIPS 2022
Asymmetric Temperature Scaling Makes Larger Networks Teach Well Again NIPS 2022
ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation NIPS 2022
Decomposing NeRF for Editing via Feature Field Distillation NIPS 2022
Measuring and Reducing Model Update Regression in Structured Prediction for NLP NIPS 2022
PKD: General Distillation Framework for Object Detectors via Pearson Correlation Coefficient NIPS 2022
Deliberated Domain Bridging for Domain Adaptive Semantic Segmentation NIPS 2022
Metric-guided Distillation: Distilling Knowledge from the Metric to Ranker and Retriever for Generative Commonsense Reasoning EMNLP 2022
Graph-based Model Generation for Few-Shot Relation Extraction EMNLP 2022
SubeventWriter: Iterative Sub-event Sequence Generation with Coherence Controller EMNLP 2022
HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classification EMNLP 2022
G-MAP: General Memory-Augmented Pre-trained Language Model for Domain Tasks EMNLP 2022
Knowledge Transfer from Answer Ranking to Answer Generation EMNLP 2022
EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation EMNLP 2022
AdaPrompt: Adaptive Model Training for Prompt-based NLP EMNLP 2022
From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models EMNLP 2022
aiML at the FinNLP-2022 ERAI Task: Combining Classification and Regression Tasks for Financial Opinion Mining EMNLP 2022