knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMs ACL 2024

LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Models ACL 2024

Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmetic ACL 2024

RDRec: Rationale Distillation for LLM-based Recommendation ACL 2024

Implanting LLM’s Knowledge via Reading Comprehension Tree for Toxicity Detection ACL 2024

BioT5+: Towards Generalized Biological Understanding with IUPAC Integration and Multi-task Tuning ACL 2024

Your Vision-Language Model Itself Is a Strong Filter: Towards High-Quality Instruction Tuning with Data Selection ACL 2024

Trust in Internal or External Knowledge? Generative Multi-Modal Entity Linking with Knowledge Retriever ACL 2024

Leveraging Entity Information for Cross-Modality Correlation Learning: The Entity-Guided Multimodal Summarization ACL 2024

Perturbed examples reveal invariances shared by language models ACL 2024

SDDGR: Stable Diffusion-based Deep Generative Replay for Class Incremental Object Detection CVPR 2024

Weakly Supervised Monocular 3D Detection with a Single-View Image CVPR 2024

Text Grouping Adapter: Adapting Pre-trained Text Detector for Layout Analysis CVPR 2024

An Aggregation-Free Federated Learning for Tackling Data Heterogeneity CVPR 2024

Improving Plasticity in Online Continual Learning via Collaborative Learning CVPR 2024

D3still: Decoupled Differential Distillation for Asymmetric Image Retrieval CVPR 2024

Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training CVPR 2024

Boosting Self-Supervision for Single-View Scene Completion via Knowledge Distillation CVPR 2024

Improving Transferable Targeted Adversarial Attacks with Model Self-Enhancement CVPR 2024

An Upload-Efficient Scheme for Transferring Knowledge From a Server-Side Pre-trained Generator to Clients in Heterogeneous Federated Learning CVPR 2024

Boosting Image Restoration via Priors from Pre-trained Models CVPR 2024

FCS: Feature Calibration and Separation for Non-Exemplar Class Incremental Learning CVPR 2024

DuPL: Dual Student with Trustworthy Progressive Learning for Robust Weakly Supervised Semantic Segmentation CVPR 2024

Domain-Rectifying Adapter for Cross-Domain Few-Shot Segmentation CVPR 2024

On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm CVPR 2024