← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Improving the Training of Rectified Flows NIPS 2024
SpikeReveal: Unlocking Temporal Sequences from Real Blurry Inputs with Spike Streams NIPS 2024
BOLD: Boolean Logic Deep Learning NIPS 2024
BiDM: Pushing the Limit of Quantization for Diffusion Models NIPS 2024
Low-Complexity Acoustic Scene Classification Using Parallel Attention-Convolution Network INTERSPEECH 2024
Coconut: Contextualized Commonsense Unified Transformers for Graph-Based Commonsense Augmentation of Language Models ACL 2024
Continual Vision-Language Retrieval via Dynamic Knowledge Rectification AAAI 2024
Efficient End-to-End Visual Document Understanding with Rationale Distillation NAACL 2024
IQ-VFI: Implicit Quadratic Motion Estimation for Video Frame Interpolation CVPR 2024
Cloud-Device Collaborative Learning for Multimodal Large Language Models CVPR 2024
Pre-trained Vision and Language Transformers Are Few-Shot Incremental Learners CVPR 2024
Learning Global Controller in Latent Space for Parameter-Efficient Fine-Tuning ACL 2024
Resource-Aware Federated Self-Supervised Learning with Global Class Representations NIPS 2024
Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMs ACL 2024
AmoebaLLM: Constructing Any-Shape Large Language Models for Efficient and Instant Deployment NIPS 2024
Induced Model Matching: Restricted Models Help Train Full-Featured Models NIPS 2024
Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment ACL 2024
Distilling CLIP with Dual Guidance for Learning Discriminative Human Body Shape Representation CVPR 2024
SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation AAAI 2024
Instance-level Expert Knowledge and Aggregate Discriminative Attention for Radiology Report Generation CVPR 2024
HYDRA-FL: Hybrid Knowledge Distillation for Robust and Accurate Federated Learning NIPS 2024
Robustness-Guided Image Synthesis for Data-Free Quantization AAAI 2024
Dynamic Sub-graph Distillation for Robust Semi-supervised Continual Learning AAAI 2024
From Instance Training to Instruction Learning: Task Adapters Generation from Instructions NIPS 2024
Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned Manifold AAAI 2024