← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Group and Shuffle: Efficient Structured Orthogonal Parametrization NIPS 2024
Can Graph Neural Networks Expose Training Data Properties? An Efficient Risk Assessment Approach NIPS 2024
Continual Audio-Visual Sound Separation NIPS 2024
Expanding Sparse Tuning for Low Memory Usage NIPS 2024
BitsFusion: 1.99 bits Weight Quantization of Diffusion Model NIPS 2024
PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Accelerator NIPS 2024
LLMCBench: Benchmarking Large Language Model Compression for Efficient Deployment NIPS 2024
Aligner: Efficient Alignment by Learning to Correct NIPS 2024
Efficient Toxic Content Detection by Bootstrapping and Distilling Large Language Models AAAI 2024
Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detection AAAI 2024
Sunshine to Rainstorm: Cross-Weather Knowledge Distillation for Robust 3D Object Detection AAAI 2024
Semi-Supervised Blind Image Quality Assessment through Knowledge Distillation and Incremental Learning AAAI 2024
Bootstrapping Cognitive Agents with a Large Language Model AAAI 2024
Improving Open Set Recognition via Visual Prompts Distilled from Common-Sense Knowledge AAAI 2024
Impartial Adversarial Distillation: Addressing Biased Data-Free Knowledge Distillation via Adaptive Constrained Optimization AAAI 2024
SGFormer: Semantic Graph Transformer for Point Cloud-Based 3D Scene Graph Generation AAAI 2024
Decoupled Contrastive Learning for Long-Tailed Recognition AAAI 2024
S3A: Towards Realistic Zero-Shot Classification via Self Structural Semantic Alignment AAAI 2024
Enhancing Cognitive Diagnosis Using Un-interacted Exercises: A Collaboration-Aware Mixed Sampling Approach AAAI 2024
Multi-Expert Distillation for Few-Shot Coordination (Student Abstract) AAAI 2024
GKT: A Novel Guidance-Based Knowledge Transfer Framework For Efficient Cloud-edge Collaboration LLM Deployment ACL 2024
A Multi-Task Embedder For Retrieval Augmented LLMs ACL 2024
Learning to Maximize Mutual Information for Chain-of-Thought Distillation ACL 2024
Continual Dialogue State Tracking via Reason-of-Select Distillation ACL 2024
Stronger, Lighter, Better: Towards Life-Long Attribute Value Extraction for E-Commerce Products ACL 2024