conftrace_

gradient computation

45 papers

Explore in graph

Co-occurring keywords

automatic differentiation (77) memory efficiency (261) neural network optimization (1293) neural network (6616) gradient descent (1144) spiking neural network (331) distributed training (188) convolutional neural network (4226) large language model (13587) model interpretability (519)

Papers

Understanding and Mitigating Exploding Inverses in Invertible Neural Networks AISTATS 2021
Symplectic Adjoint Method for Exact Gradient of Neural ODE with Minimal Memory NIPS 2021
Unifying Activation- and Timing-based Learning Rules for Spiking Neural Networks NIPS 2020
Optimal and Practical Algorithms for Smooth and Strongly Convex Decentralized Optimization NIPS 2020
Scalable Gradients for Stochastic Differential Equations AISTATS 2020
Automatic Differentiation of Sketched Regression AISTATS 2020
Differentiable Cloth Simulation for Inverse Problems NIPS 2019
AutoAssist: A Framework to Accelerate Training of Deep Neural Networks NIPS 2019
An Investigation into On-Device Personalization of End-to-End Automatic Speech Recognition Models INTERSPEECH 2019
Hybrid Macro/Micro Level Backpropagation for Training Deep Spiking Neural Networks NIPS 2018
Tangent: Automatic differentiation using source-code transformation for dynamically typed array programming NIPS 2018
Adaptive balancing of gradient and update computation times using global geometry and approximate subproblems AISTATS 2018
Automatic Differentiation in Machine Learning: a Survey JMLR 2018
Provably Correct Automatic Sub-Differentiation for Qualified Programs NIPS 2018
Efficient Gradient Computation for Structured Output Learning with Rational and Tropical Losses NIPS 2018
Differential Properties of Sinkhorn Approximation for Learning with Wasserstein Distance NIPS 2018
Training Deep Neural Networks with 8-bit Floating Point Numbers NIPS 2018
The Reversible Residual Network: Backpropagation Without Storing Activations NIPS 2017
Understanding the Effective Receptive Field in Deep Convolutional Neural Networks NIPS 2016
Efficient Large-Scale Distributed Training of Conditional Maximum Entropy Models NIPS 2009