conftrace_

knowledge distillation

4,137 papers

Explore in graph

Also known as

KD

Co-occurring keywords · papers mentioning both

model compression (1,124) large language model (415) transfer learning (313) representation learning (209) domain adaptation (202) neural network (188) catastrophic forgetting (183) language model (180) continual learning (176) contrastive learning (169)

Papers

The False Promise of Imitating Proprietary Language Models ICLR 2024 The Mamba in the Llama: Distilling and Accelerating Hybrid Models NeurIPS 2024 Three Heads Are Better than One: Improving Cross-Domain NER with Progressive Decomposed Network AAAI 2024 Three Pillars Improving Vision Foundation Model Distillation for Lidar CVPR 2024 TIKP: Text-to-Image Knowledge Preservation for Continual Semantic Segmentation AAAI 2024 TinyChart: Efficient Chart Understanding with Program-of-Thoughts Learning and Visual Token Merging EMNLP 2024 tinyCLAP: Distilling Constrastive Language-Audio Pretrained Models Interspeech 2024 To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillation ACL 2024 Towards an On-device Agent for Text Rewriting NAACL 2024 Towards Backward-Compatible Continual Learning of Image Compression CVPR 2024 Towards Diverse Device Heterogeneous Federated Learning via Task Arithmetic Knowledge Integration NeurIPS 2024 Towards Domain-Aware Knowledge Distillation for Continual Model Generalization WACV 2024 Towards Robust and Efficient Cloud-Edge Elastic Model Adaptation via Selective Entropy Distillation ICLR 2024 Toward Student-oriented Teacher Network Training for Knowledge Distillation ICLR 2024 ToXCL: A Unified Framework for Toxic Speech Detection and Explanation NAACL 2024 Trace-of-Thought Prompting: Investigating Prompt-Based Knowledge Distillation Through Question Decomposition ACL 2024 Training a Better Chinese Spelling Correction Model via Prior-knowledge Guided Teacher ACL 2024 Training Graph Transformers via Curriculum-Enhanced Attention Distillation ICLR 2024 TransAgent: Transfer Vision-Language Foundation Models with Heterogeneous Agent Collaboration NeurIPS 2024 TransferCVLM: Transferring Cross-Modal Knowledge for Vision-Language Modeling EMNLP 2024 Transformer as Linear Expansion of Learngene AAAI 2024 Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models NeurIPS 2024 TriSum: Learning Summarization Ability from Large Language Models with Structured Rationale NAACL 2024 Trust in Internal or External Knowledge? Generative Multi-Modal Entity Linking with Knowledge Retriever ACL 2024 TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models EMNLP 2024