Skip to content
conftrace_

snapshot distillation

2 papers

Explore in graph

Also known as

SD

Co-occurring keywords · papers mentioning both

knowledge distillation (2) cyclic learning rate (1) teacher-student optimization (1) neural network (1) sample distillation (1) teacher-student training (1) neural network optimization (1) model pretraining (1) self-supervised learning (1) transfer learning (1)

Papers

Long Short-Term Sample Distillation AAAI 2020 Snapshot Distillation: Teacher-Student Optimization in One Generation CVPR 2019