conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Investigating and Mitigating the Multimodal Hallucination Snowballing in Large Vision-Language Models ACL 2024
Improving Text Embeddings with Large Language Models ACL 2024
Cross-Modal Match for Language Conditioned 3D Object Grounding AAAI 2024
Rethinking Reverse Distillation for Multi-Modal Anomaly Detection AAAI 2024
Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation AAAI 2024
Amalgamating Multi-Task Models with Heterogeneous Architectures AAAI 2024
KnowledgeSG: Privacy-Preserving Synthetic Text Generation with Knowledge Distillation from Server EMNLP 2024
RA2FD: Distilling Faithfulness into Efficient Dialogue Systems EMNLP 2024
FIRST: Teach A Reliable Large Language Model Through Efficient Trustworthy Distillation EMNLP 2024
Optimizing Chinese Lexical Simplification Across Word Types: A Hybrid Approach EMNLP 2024
Improve Student’s Reasoning Generalizability through Cascading Decomposed CoTs Distillation EMNLP 2024
Dual-Space Knowledge Distillation for Large Language Models EMNLP 2024
SynthesizRR: Generating Diverse Datasets with Retrieval Augmentation EMNLP 2024
xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metrics EMNLP 2024
BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrievers EMNLP 2024
INDUS: Effective and Efficient Language Models for Scientific Applications EMNLP 2024
RRADistill: Distilling LLMs’ Passage Ranking Ability for Long-Tail Queries Document Re-Ranking on a Search Engine EMNLP 2024
Visual Editing with LLM-based Tool Chaining: An Efficient Distillation Approach for Real-Time Applications EMNLP 2024
GOVERN: Gradient Orientation Vote Ensemble for Multi-Teacher Reinforced Distillation EMNLP 2024
BSharedRAG: Backbone Shared Retrieval-Augmented Generation for the E-commerce Domain EMNLP 2024
Mixed Distillation Helps Smaller Language Models Reason Better EMNLP 2024
Divide-or-Conquer? Which Part Should You Distill Your LLM? EMNLP 2024
Privacy Evaluation Benchmarks for NLP Models EMNLP 2024
Evolutionary Contrastive Distillation for Language Model Alignment EMNLP 2024
Dual-teacher Knowledge Distillation for Low-frequency Word Translation EMNLP 2024