← Keywords

model distillation

105 papers

Explore in graph

Also known as

PMD

Co-occurring keywords

knowledge distillation (3680) model compression (3283) diffusion model (3720) large language model (12755) image generation (2069) generative model (2889) federated learning (1320) neural network (6616) one-step generation (20) transfer learning (5442)

Papers

Plug-and-Play Diffusion Distillation CVPR 2024
SinSR: Diffusion-Based Image Super-Resolution in a Single Step CVPR 2024
Multistep Distillation of Diffusion Models via Moment Matching NIPS 2024
Investigating Mysteries of CoT-Augmented Distillation EMNLP 2024
A Closer Look at Self-Supervised Lightweight Vision Transformers ICML 2023
Students Parrot Their Teachers: Membership Inference on Model Distillation NIPS 2023
MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers EACL 2023
Probing Cross-Lingual Lexical Knowledge from Multilingual Sentence Encoders EACL 2023
Specializing Smaller Language Models towards Multi-Step Reasoning ICML 2023
StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesis ICML 2023
Bayesian Federated Neural Matching That Completes Full Information AAAI 2023
One-Step Diffusion Distillation via Deep Equilibrium Models NIPS 2023
CaPriDe Learning: Confidential and Private Decentralized Learning Based on Encryption-Friendly Distillation Loss CVPR 2023
MixFormerV2: Efficient Fully Transformer Tracking NIPS 2023
Speculative Decoding with Big Little Decoder NIPS 2023
On Distillation of Guided Diffusion Models CVPR 2023
DISCO: Distilling Counterfactuals with Large Language Models ACL 2023
Breaching FedMD: Image Recovery via Paired-Logits Inversion Attack CVPR 2023
Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method ACL 2023
Consistency Models ICML 2023
Distilling Internet-Scale Vision-Language Models into Embodied Agents ICML 2023
Protecting Language Generation Models via Invisible Watermarking ICML 2023
F-coref: Fast, Accurate and Easy to Use Coreference Resolution AACL 2022
On the Efficacy of Small Self-Supervised Contrastive Models without Distillation Signals AAAI 2022
SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages EMNLP 2022