← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

OpenESS: Event-based Semantic Scene Understanding with Open Vocabularies CVPR 2024
SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretraining CVPR 2024
Mentor-KD: Making Small Language Models Better Multi-step Reasoners EMNLP 2024
Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation EMNLP 2024
CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies EMNLP 2024
Enhancing Legal Expertise in Large Language Models through Composite Model Integration: The Development and Evaluation of Law-Neo EMNLP 2024
Multimodal Machine Translation for Low-Resource Indic Languages: A Chain-of-Thought Approach Using Large Language Models EMNLP 2024
Hybrid Distillation from RBMT and NMT: Helsinki-NLP’s Submission to the Shared Task on Translation into Low-Resource Languages of Spain EMNLP 2024
On Instruction-Finetuning Neural Machine Translation Models EMNLP 2024
Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translation EMNLP 2024
Distilling Knowledge from Text-to-Image Generative Models Improves Visio-Linguistic Reasoning in CLIP EMNLP 2024
Learning from Natural Language Explanations for Generalizable Entity Matching EMNLP 2024
CapEEN: Image Captioning with Early Exits and Knowledge Distillation EMNLP 2024
TransferCVLM: Transferring Cross-Modal Knowledge for Vision-Language Modeling EMNLP 2024
Further Compressing Distilled Language Models via Frequency-aware Partial Sparse Coding of Embeddings EMNLP 2024
Contrastive Learning to Improve Retrieval for Real-World Fact Checking EMNLP 2024
StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style Elements EMNLP 2024
Multiple Sources are Better Than One: Incorporating External Knowledge in Low-Resource Glossing EMNLP 2024
Probing the Depths of Language Models’ Contact-Center Knowledge for Quality Assurance EMNLP 2024
Neural Search Space in Gboard Decoder EMNLP 2024
LoRAExit: Empowering Dynamic Modulation of LLMs in Resource-limited Settings using Low-rank Adapters EMNLP 2024
Unveiling Implicit Table Knowledge with Question-Then-Pinpoint Reasoner for Insightful Table Summarization EMNLP 2024
Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging EMNLP 2024
Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models NIPS 2024
WebUOT-1M: Advancing Deep Underwater Object Tracking with A Million-Scale Benchmark NIPS 2024