conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models NIPS 2024
Search for Efficient Large Language Models NIPS 2024
On the Surprising Effectiveness of Attention Transfer for Vision Transformers NIPS 2024
HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMs ACL 2024
LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Models ACL 2024
Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmetic ACL 2024
TASeg: Temporal Aggregation Network for LiDAR Semantic Segmentation CVPR 2024
De-confounded Data-free Knowledge Distillation for Handling Distribution Shifts CVPR 2024
CADTalk: An Algorithm and Benchmark for Semantic Commenting of CAD Programs CVPR 2024
Unveiling Implicit Table Knowledge with Question-Then-Pinpoint Reasoner for Insightful Table Summarization EMNLP 2024
Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging EMNLP 2024
HumanVLA: Towards Vision-Language Directed Object Rearrangement by Physical Humanoid NIPS 2024
Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models NIPS 2024
PDF: A Probability-Driven Framework for Open World 3D Point Cloud Semantic Segmentation CVPR 2024
A Versatile Framework for Continual Test-Time Domain Adaptation: Balancing Discriminability and Generalizability CVPR 2024
Active Object Detection with Knowledge Aggregation and Distillation from Large Models CVPR 2024
Weak-to-Strong 3D Object Detection with X-Ray Distillation CVPR 2024
Incremental Nuclei Segmentation from Histopathological Images via Future-class Awareness and Compatibility-inspired Distillation CVPR 2024
MV-Adapter: Multimodal Video Transfer Learning for Video Text Retrieval CVPR 2024
Unsupervised Video Domain Adaptation with Masked Pre-Training and Collaborative Self-Training CVPR 2024
Efficient Multitask Dense Predictor via Binarization CVPR 2024
Learning Background Prompts to Discover Implicit Knowledge for Open Vocabulary Object Detection CVPR 2024
RadarDistill: Boosting Radar-based Object Detection Performance via Knowledge Distillation from LiDAR Features CVPR 2024
Scene-adaptive and Region-aware Multi-modal Prompt for Open Vocabulary Object Detection CVPR 2024
LiSA: LiDAR Localization with Semantic Awareness CVPR 2024