conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Aligner: Efficient Alignment by Learning to Correct NIPS 2024
FreeKD: Knowledge Distillation via Semantic Frequency Prompt CVPR 2024
LLMCBench: Benchmarking Large Language Model Compression for Efficient Deployment NIPS 2024
PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Accelerator NIPS 2024
BitsFusion: 1.99 bits Weight Quantization of Diffusion Model NIPS 2024
Expanding Sparse Tuning for Low Memory Usage NIPS 2024
Continual Audio-Visual Sound Separation NIPS 2024
Can Graph Neural Networks Expose Training Data Properties? An Efficient Risk Assessment Approach NIPS 2024
Group and Shuffle: Efficient Structured Orthogonal Parametrization NIPS 2024
Cross-modal Representation Flattening for Multi-modal Domain Generalization NIPS 2024
The Mamba in the Llama: Distilling and Accelerating Hybrid Models NIPS 2024
Boosting Vision-Language Models with Transduction NIPS 2024
Text-like Encoding of Collaborative Information in Large Language Models for Recommendation ACL 2024
MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning ACL 2024
Out of Thin Air: Exploring Data-Free Adversarial Robustness Distillation AAAI 2024
Data Distribution Distilled Generative Model for Generalized Zero-Shot Recognition AAAI 2024
Hypercorrelation Evolution for Video Class-Incremental Learning AAAI 2024
Expediting Contrastive Language-Image Pretraining via Self-Distilled Encoders AAAI 2024
Efficient Spiking Neural Networks with Sparse Selective Activation for Continual Learning AAAI 2024
How to Trade Off the Quantity and Capacity of Teacher Ensemble: Learning Categorical Distribution to Stochastically Employ a Teacher for Distillation AAAI 2024
Reducing Spatial Fitting Error in Distillation of Denoising Diffusion Models AAAI 2024
Knowledge Distillation in Automated Annotation: Supervised Text Classification with LLM-Generated Training Labels NAACL 2024
LEMON: Reviving Stronger and Smaller LMs from Larger LMs with Linear Parameter Fusion ACL 2024
Turning Dust into Gold: Distilling Complex Reasoning Capabilities from LLMs by Leveraging Negative Data AAAI 2024
Domain Adaptation for Large-Vocabulary Object Detectors NIPS 2024