conftrace_

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Revisiting the Knowledge Injection Frameworks EMNLP 2023

UDAPDR: Unsupervised Domain Adaptation via LLM Prompting and Distillation of Rerankers EMNLP 2023

Select, Prompt, Filter: Distilling Large Language Models for Summarizing Conversations EMNLP 2023

Multi-Task Knowledge Distillation with Embedding Constraints for Scholarly Keyphrase Boundary Classification EMNLP 2023

KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination Detection EMNLP 2023

Text Representation Distillation via Information Bottleneck Principle EMNLP 2023

Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation EMNLP 2023

FreeAL: Towards Human-Free Active Learning in the Era of Large Language Models EMNLP 2023

Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents EMNLP 2023

Fabricator: An Open Source Toolkit for Generating Labeled Training Data with Teacher LLMs EMNLP 2023

H2O Open Ecosystem for State-of-the-art Large Language Models EMNLP 2023

Prompt2Model: Generating Deployable Models from Natural Language Instructions EMNLP 2023

A Comparative Analysis of Task-Agnostic Distillation Methods for Compressing Transformer Language Models EMNLP 2023

Multi-teacher Distillation for Multilingual Spelling Correction EMNLP 2023

EELBERT: Tiny Models through Dynamic Embeddings EMNLP 2023

Approximating Two-Layer Feedforward Networks for Efficient Transformers EMNLP 2023

NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation EMNLP 2023

Cometoid: Distilling Strong Reference-based Machine Translation Metrics into Even Stronger Quality Estimation Metrics EMNLP 2023

Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inference EMNLP 2023

KD-Boost: Boosting Real-Time Semantic Matching in E-commerce with Knowledge Distillation EMNLP 2023

Exploring Transformers as Compact, Data-efficient Language Models EMNLP 2023

Condensing Multilingual Knowledge with Lightweight Language-Specific Modules EMNLP 2023

Towards a Unified Conversational Recommendation System: Multi-task Learning via Contextualized Knowledge Distillation EMNLP 2023

Complex Event Schema Induction with Knowledge-Enriched Diffusion Model EMNLP 2023

Continual Detection Transformer for Incremental Object Detection CVPR 2023