conftrace_
← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions NIPS 2023
StereoDistill: Pick the Cream from LiDAR for Distilling Stereo-Based 3D Object Detection AAAI 2023
How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources NIPS 2023
Distilling Universal and Joint Knowledge for Cross-Domain Model Compression on Time Series Data IJCAI 2023
Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfer AAAI 2023
Disentangle and Remerge: Interventional Knowledge Distillation for Few-Shot Object Detection from a Conditional Causal Perspective AAAI 2023
Whole-slide-imaging Cancer Metastases Detection and Localization with Limited Tumorous Data MIDL 2023
Exploring Transformers as Compact, Data-efficient Language Models EMNLP 2023
Multi-mode Neural Speech Coding Based on Deep Generative Networks INTERSPEECH 2023
Learning When to Trust Which Teacher for Weakly Supervised ASR INTERSPEECH 2023
Lifelong Compression Mixture Model via Knowledge Relationship Graph AAAI 2023
SFT-KD-Recon: Learning a Student-friendly Teacher for Knowledge Distillation in Magnetic Resonance Image Reconstruction MIDL 2023
Overcoming Forgetting in Fine-Grained Urban Flow Inference via Adaptive Knowledge Replay AAAI 2023
CrysGNN: Distilling Pre-trained Knowledge to Enhance Property Prediction for Crystalline Materials AAAI 2023
LIMIP: Lifelong Learning to Solve Mixed Integer Programs AAAI 2023
Efficient Image Captioning for Edge Devices AAAI 2023
SKDBERT: Compressing BERT via Stochastic Knowledge Distillation AAAI 2023
IterDE: An Iterative Knowledge Distillation Framework for Knowledge Graph Embeddings AAAI 2023
Lifelong Person Re-identification via Knowledge Refreshing and Consolidation AAAI 2023
Mind the Gap: Polishing Pseudo Labels for Accurate Semi-supervised Object Detection AAAI 2023
MulGT: Multi-Task Graph-Transformer with Task-Aware Knowledge Injection and Domain Knowledge-Driven Pooling for Whole Slide Image Analysis AAAI 2023
Online Hyperparameter Optimization for Class-Incremental Learning AAAI 2023
Rethinking Data-Free Quantization as a Zero-Sum Game AAAI 2023
DisGUIDE: Disagreement-Guided Data-Free Model Extraction AAAI 2023
FedABC: Targeting Fair Competition in Personalized Federated Learning AAAI 2023