conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer NIPS 2023
ZipLM: Inference-Aware Structured Pruning of Language Models NIPS 2023
Interactive Multi-fidelity Learning for Cost-effective Adaptation of Language Model with Sparse Human Supervision NIPS 2023
Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions NIPS 2023
How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources NIPS 2023
Lifelong Compression Mixture Model via Knowledge Relationship Graph AAAI 2023
Overcoming Forgetting in Fine-Grained Urban Flow Inference via Adaptive Knowledge Replay AAAI 2023
CrysGNN: Distilling Pre-trained Knowledge to Enhance Property Prediction for Crystalline Materials AAAI 2023
LIMIP: Lifelong Learning to Solve Mixed Integer Programs AAAI 2023
Efficient Image Captioning for Edge Devices AAAI 2023
SKDBERT: Compressing BERT via Stochastic Knowledge Distillation AAAI 2023
IterDE: An Iterative Knowledge Distillation Framework for Knowledge Graph Embeddings AAAI 2023
Lifelong Person Re-identification via Knowledge Refreshing and Consolidation AAAI 2023
Mind the Gap: Polishing Pseudo Labels for Accurate Semi-supervised Object Detection AAAI 2023
MulGT: Multi-Task Graph-Transformer with Task-Aware Knowledge Injection and Domain Knowledge-Driven Pooling for Whole Slide Image Analysis AAAI 2023
Online Hyperparameter Optimization for Class-Incremental Learning AAAI 2023
Rethinking Data-Free Quantization as a Zero-Sum Game AAAI 2023
DisGUIDE: Disagreement-Guided Data-Free Model Extraction AAAI 2023
FedABC: Targeting Fair Competition in Personalized Federated Learning AAAI 2023
Improving Distantly Supervised Relation Extraction by Natural Language Inference AAAI 2023
Leveraging Old Knowledge to Continually Learn New Classes in Medical Images AAAI 2023
Pretrained Bidirectional Distillation for Machine Translation ACL 2023
Improving Continual Relation Extraction by Distinguishing Analogous Semantics ACL 2023
Deep Model Compression Also Helps Models Capture Ambiguity ACL 2023
Multi-Level Knowledge Distillation for Out-of-Distribution Detection in Text ACL 2023