conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Coconut: Contextualized Commonsense Unified Transformers for Graph-Based Commonsense Augmentation of Language Models ACL 2024
Continual Vision-Language Retrieval via Dynamic Knowledge Rectification AAAI 2024
Efficient End-to-End Visual Document Understanding with Rationale Distillation NAACL 2024
IQ-VFI: Implicit Quadratic Motion Estimation for Video Frame Interpolation CVPR 2024
Cloud-Device Collaborative Learning for Multimodal Large Language Models CVPR 2024
Pre-trained Vision and Language Transformers Are Few-Shot Incremental Learners CVPR 2024
Learning Global Controller in Latent Space for Parameter-Efficient Fine-Tuning ACL 2024
Resource-Aware Federated Self-Supervised Learning with Global Class Representations NIPS 2024
Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMs ACL 2024
AmoebaLLM: Constructing Any-Shape Large Language Models for Efficient and Instant Deployment NIPS 2024
Induced Model Matching: Restricted Models Help Train Full-Featured Models NIPS 2024
Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment ACL 2024
Distilling CLIP with Dual Guidance for Learning Discriminative Human Body Shape Representation CVPR 2024
SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation AAAI 2024
Instance-level Expert Knowledge and Aggregate Discriminative Attention for Radiology Report Generation CVPR 2024
HYDRA-FL: Hybrid Knowledge Distillation for Robust and Accurate Federated Learning NIPS 2024
Robustness-Guided Image Synthesis for Data-Free Quantization AAAI 2024
Dynamic Sub-graph Distillation for Robust Semi-supervised Continual Learning AAAI 2024
From Instance Training to Instruction Learning: Task Adapters Generation from Instructions NIPS 2024
Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned Manifold AAAI 2024
Layer Compression of Deep Networks with Straight Flows AAAI 2024
Summarizing Stream Data for Memory-Constrained Online Continual Learning AAAI 2024
The ALCHEmist: Automated Labeling 500x CHEaper than LLM Data Annotators NIPS 2024
Logit Standardization in Knowledge Distillation CVPR 2024
KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling CVPR 2024