conftrace_
← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Quantized Feature Distillation for Network Quantization AAAI 2023
General In-hand Object Rotation with Vision and Touch CORL 2023
ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation CORL 2023
Learn With Martian: A Tool For Creating Assignments That Can Write And Re-Write Themselves EACL 2023
PRCA: Fitting Black-Box Large Language Models for Retrieval Question Answering via Pluggable Reward-Driven Contextual Adapter EMNLP 2023
PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillation EMNLP 2023
Knowledge Distillation ≈ Label Smoothing: Fact or Fallacy? EMNLP 2023
Exploring All-In-One Knowledge Distillation Framework for Neural Machine Translation EMNLP 2023
Understanding the Effect of Model Compression on Social Bias in Large Language Models EMNLP 2023
TrueTeacher: Learning Factual Consistency Evaluation with Large Language Models EMNLP 2023
Democratizing Reasoning Ability: Tailored Learning from Large Language Model EMNLP 2023
CombLM: Adapting Black-Box Language Models through Small Fine-Tuned Models EMNLP 2023
Lion: Adversarial Distillation of Proprietary Large Language Models EMNLP 2023
DisCo: Distilled Student Models Co-training for Semi-supervised Text Mining EMNLP 2023
Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective EACL 2023
You Can Have Your Data and Balance It Too: Towards Balanced and Efficient Multilingual Models EACL 2023
Towards Robust Pruning: An Adaptive Knowledge-Retention Pruning Strategy for Language Models EMNLP 2023
IAG: Induction-Augmented Generation Framework for Answering Reasoning Questions EMNLP 2023
Efficient Transformer Knowledge Distillation: A Performance Review EMNLP 2023
Copyright-Certified Distillation Dataset: Distilling One Million Coins into One Bitcoin with Your Private Key AAAI 2023
One Is All: Bridging the Gap between Neural Radiance Fields Architectures with Progressive Volume Distillation AAAI 2023
Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inference EMNLP 2023
KD-Boost: Boosting Real-Time Semantic Matching in E-commerce with Knowledge Distillation EMNLP 2023
RD-Suite: A Benchmark for Ranking Distillation NIPS 2023
Parameter-efficient Tuning for Large Language Model without Calculating Its Gradients EMNLP 2023