conftrace_
← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesis NIPS 2024
Depth Anywhere: Enhancing 360 Monocular Depth Estimation via Perspective Distillation and Unlabeled Data Augmentation NIPS 2024
SELECT: A Large-Scale Benchmark of Data Curation Strategies for Image Classification NIPS 2024
LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS NIPS 2024
Offline Behavior Distillation NIPS 2024
Fine-Tuning is Fine, if Calibrated NIPS 2024
HYDRA: Model Factorization Framework for Black-Box LLM Personalization NIPS 2024
Teaching Tiny Minds: Exploring Methods to Enhance Knowledge Distillation for Small Language Models CONLL 2024
NEO-KD: Knowledge-Distillation-Based Adversarial Training for Robust Multi-Exit Neural Networks NIPS 2023
PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection CVPR 2023
Instance Relation Graph Guided Source-Free Domain Adaptive Object Detection CVPR 2023
DistilPose: Tokenized Pose Regression With Heatmap Distillation CVPR 2023
DREAM: Efficient Dataset Distillation by Representative Matching ICCV 2023
Parameter-Efficient Model Adaptation for Vision Transformers AAAI 2023
Neural TSP Solver with Progressive Distillation AAAI 2023
Goal-Conditioned Q-learning as Knowledge Distillation AAAI 2023
Explicit Invariant Feature Induced Cross-Domain Crowd Counting AAAI 2023
Intuitive Access to Smartphone Settings Using Relevance Model Trained by Contrastive Learning AAAI 2023
Compressing Cross-Lingual Multi-Task Models at Qualtrics AAAI 2023
Improving Robust Fariness via Balance Adversarial Training AAAI 2023
A Neural Span-Based Continual Named Entity Recognition Model AAAI 2023
Self-Supervised Distilled Learning for Multi-Modal Misinformation Identification WACV 2023
Understanding the Role of Mixup in Knowledge Distillation: An Empirical Study WACV 2023
Collaborative Multi-Teacher Knowledge Distillation for Learning Low Bit-Width Deep Neural Networks WACV 2023
MGIA: Mutual Gradient Inversion Attack in Multi-Modal Federated Learning (Student Abstract) AAAI 2023