conftrace_

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

ERNIE-ViLG 2.0: Improving Text-to-Image Diffusion Model With Knowledge-Enhanced Mixture-of-Denoising-Experts CVPR 2023

1% VS 100%: Parameter-Efficient Low Rank Adapter for Dense Predictions CVPR 2023

Query Enhanced Knowledge-Intensive Conversation via Unsupervised Joint Modeling ACL 2023

Analyzing and Reducing the Performance Gap in Cross-Lingual Transfer with Fine-tuning Slow and Fast ACL 2023

PuMer: Pruning and Merging Tokens for Efficient Vision Language Models ACL 2023

Towards Fewer Hallucinations in Knowledge-Grounded Dialogue Generation via Augmentative and Contrastive Knowledge-Dialogue ACL 2023

Commonsense Knowledge Transfer for Pre-trained Language Models ACL 2023

Learning from a Friend: Improving Event Extraction via Self-Training with Feedback from Abstract Meaning Representation ACL 2023

HuaSLIM: Human Attention Motivated Shortcut Learning Identification and Mitigation for Large Language models ACL 2023

Prompt2Model: Generating Deployable Models from Natural Language Instructions EMNLP 2023

H2O Open Ecosystem for State-of-the-art Large Language Models EMNLP 2023

Fabricator: An Open Source Toolkit for Generating Labeled Training Data with Teacher LLMs EMNLP 2023

Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents EMNLP 2023

FreeAL: Towards Human-Free Active Learning in the Era of Large Language Models EMNLP 2023

Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation EMNLP 2023

Text Representation Distillation via Information Bottleneck Principle EMNLP 2023

KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination Detection EMNLP 2023

Multi-Task Knowledge Distillation with Embedding Constraints for Scholarly Keyphrase Boundary Classification EMNLP 2023

Select, Prompt, Filter: Distilling Large Language Models for Summarizing Conversations EMNLP 2023

UDAPDR: Unsupervised Domain Adaptation via LLM Prompting and Distillation of Rerankers EMNLP 2023

itKD: Interchange Transfer-Based Knowledge Distillation for 3D Object Detection CVPR 2023

TinyMIM: An Empirical Study of Distilling MIM Pre-Trained Models CVPR 2023

Boost Vision Transformer With GPU-Friendly Sparsity and Quantization CVPR 2023

SCPNet: Semantic Scene Completion on Point Cloud CVPR 2023

Revisiting the Knowledge Injection Frameworks EMNLP 2023