conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

INK: Injecting kNN Knowledge in Nearest Neighbor Machine Translation ACL 2023
ReAugKD: Retrieval-Augmented Knowledge Distillation For Pre-trained Language Models ACL 2023
Teaching Small Language Models to Reason ACL 2023
Few Shot Rationale Generation using Self-Training with Dual Teachers ACL 2023
Storyline-Centric Detection of Aphasia and Dysarthria in Stroke Patient Transcripts ACL 2023
ML Mob at SemEval-2023 Task 5: “Breaking News: Our Semi-Supervised and Multi-Task Learning Approach Spoils Clickbait” ACL 2023
Multi-CLS BERT: An Efficient Alternative to Traditional Ensembling ACL 2023
Operator Selection and Ordering in a Pipeline Approach to Efficiency Optimizations for Transformers ACL 2023
Triplet-Free Knowledge-Guided Response Generation ACL 2023
CocaCLIP: Exploring Distillation of Fully-Connected Knowledge Interaction Graph for Lightweight Text-Image Retrieval ACL 2023
Boost Transformer-based Language Models with GPU-Friendly Sparsity and Quantization ACL 2023
Federated Domain Adaptation for Named Entity Recognition via Distilling with Heterogeneous Tag Sets ACL 2023
Labels are not necessary: Assessing peer-review helpfulness using domain adaptation based on self-training ACL 2023
f-Divergence Minimization for Sequence-Level Knowledge Distillation ACL 2023
G3R: A Graph-Guided Generate-and-Rerank Framework for Complex and Cross-domain Text-to-SQL Generation ACL 2023
When Gradient Descent Meets Derivative-Free Optimization: A Match Made in Black-Box Scenario ACL 2023
CKDST: Comprehensively and Effectively Distill Knowledge from Machine Translation to End-to-End Speech Translation ACL 2023
Adaptive Contrastive Knowledge Distillation for BERT Compression ACL 2023
Jointly Reparametrized Multi-Layer Adaptation for Efficient and Private Tuning ACL 2023
Long-Tailed Question Answering in an Open World ACL 2023
A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training ACL 2023
Domain-specific transformer models for query translation ACL 2023
Sharing Encoder Representations across Languages, Domains and Tasks in Large-Scale Spoken Language Understanding ACL 2023
Distilling Calibrated Knowledge for Stance Detection ACL 2023
Attend, Select and Eliminate: Accelerating Multi-turn Response Selection with Dual-attention-based Content Elimination ACL 2023