DrMAD: Distilling Reverse-Mode Automatic Differentiation for Optimizing Hyperparameters of Deep Neural Networks

Jie Fu; Hongyin Luo; Jiashi Feng; Kian Hsiang Low; Tat-Seng Chua

2016 IJCAI IJCAI 2016

DrMAD: Distilling Reverse-Mode Automatic Differentiation for Optimizing Hyperparameters of Deep Neural Networks

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

📈 Trend Setter - Knowledge Distillation

🐣 Hot Topic Early Bird - hyperparameter optimization

Authors

Jie Fu, Hongyin Luo, Jiashi Feng, Kian Hsiang Low, Tat-Seng Chua

Topics

Machine Learning > Optimization & Theory > Neural Network Optimization Machine Learning > Application Areas > Knowledge Distillation

Keywords

hyperparameter optimization knowledge distillation automatic differentiation

Download PDF