conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Interweaving Memories of a Siamese Large Language Model AAAI 2025
Distilling Structured Rationale from Large Language Models to Small Language Models for Abstractive Summarization AAAI 2025
PAP2PAT: Benchmarking Outline-Guided Long-Text Patent Generation with Patent-Paper Pairs ACL 2025
Investigating and Enhancing Vision-Audio Capability in Omnimodal Large Language Models ACL 2025
Multimodal Commonsense Knowledge Distillation for Visual Question Answering (Student Abstract) AAAI 2025
Federated Learning with Heterogeneous LLMs: Integrating Small Student Client Models with a Large Hungry Model AAAI 2025
Improving SAM for Camouflaged Object Detection via Dual Stream Adapters ICCV 2025
Enhancing Cross-Tokenizer Knowledge Distillation with Contextual Dynamical Mapping ACL 2025
Boosting LLM Translation Skills without General Ability Loss via Rationale Distillation ACL 2025
Fed-DFA: Federated Distillation for Heterogeneous Model Fusion Through the Adversarial Lens AAAI 2025
Learning from Committee: Reasoning Distillation from a Mixture of Teachers with Peer-Review ACL 2025
Revisiting Weak-to-Strong Generalization in Theory and Practice: Reverse KL vs. Forward KL ACL 2025
Toward Efficient Data-Free Unlearning AAAI 2025
Can Students Beyond the Teacher? Distilling Knowledge from Teacher’s Bias AAAI 2025
Unlearning Backdoor Attacks for LLMs with Weak-to-Strong Knowledge Distillation ACL 2025
MaTVLM: Hybrid Mamba-Transformer for Efficient Vision-Language Modeling ICCV 2025
Building a Family of Data Augmentation Models for Low-cost LLM Fine-tuning on the Cloud COLING 2025
Optimizing Quantized Diffusion Models via Distillation with Cross-Timestep Error Correction AAAI 2025
Emo Pillars: Knowledge Distillation to Support Fine-Grained Context-Aware and Context-Less Emotion Classification ACL 2025
The Self-Improvement Paradox: Can Language Models Bootstrap Reasoning Capabilities without External Scaffolding? ACL 2025
Multi-Sense Embeddings for Language Models and Knowledge Distillation ACL 2025
EBBS: An Ensemble with Bi-Level Beam Search for Zero-Shot Machine Translation AAAI 2025
DistilQwen2.5: Industrial Practices of Training Distilled Open Lightweight Language Models ACL 2025
Memorization Inheritance in Sequence-Level Knowledge Distillation for Neural Machine Translation ACL 2025
Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction ACL 2025