conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

Exactly Computing the Local Lipschitz Constant of ReLU Networks NIPS 2020
A Bayesian Perspective on Training Speed and Model Selection NIPS 2020
On Infinite-Width Hypernetworks NIPS 2020
A Statistical Framework for Low-bitwidth Training of Deep Neural Networks NIPS 2020
Neural Networks Fail to Learn Periodic Functions and How to Fix It NIPS 2020
A shooting formulation of deep learning NIPS 2020
Kernel Based Progressive Distillation for Adder Neural Networks NIPS 2020
Reconciling Modern Deep Learning with Traditional Optimization Analyses: The Intrinsic Learning Rate NIPS 2020
A Theoretical Framework for Target Propagation NIPS 2020
Learning Parities with Neural Networks NIPS 2020
AutoSync: Learning to Synchronize for Data-Parallel Distributed Deep Learning NIPS 2020
ExpandNets: Linear Over-parameterization to Train Compact Convolutional Networks NIPS 2020
Ultra-Low Precision 4-bit Training of Deep Neural Networks NIPS 2020
Self-Distillation Amplifies Regularization in Hilbert Space NIPS 2020
How to Characterize The Landscape of Overparameterized Convolutional Neural Networks NIPS 2020
On the training dynamics of deep networks with $L_2$ regularization NIPS 2020
Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropout NIPS 2020
A mathematical model for automatic differentiation in machine learning NIPS 2020
Escaping the Gravitational Pull of Softmax NIPS 2020
On the Loss Landscape of Adversarial Training: Identifying Challenges and How to Overcome Them NIPS 2020
HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural Networks NIPS 2020
Assessing Local Generalization Capability in Deep Models AISTATS 2020
DropNAS: Grouped Operation Dropout for Differentiable Architecture Search IJCAI 2020
DWM: A Decomposable Winograd Method for Convolution Acceleration AAAI 2020
Inefficiency of K-FAC for Large Batch Size Training AAAI 2020