conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

Fast and Accurate Model Scaling CVPR 2021
SKFAC: Training Neural Networks With Faster Kronecker-Factored Approximate Curvature CVPR 2021
S$^3$: Sign-Sparse-Shift Reparametrization for Effective Training of Low-bit Shift Networks NIPS 2021
Efficient Neural Network Training via Forward and Backward Propagation Sparsification NIPS 2021
Why Approximate Matrix Square Root Outperforms Accurate SVD in Global Covariance Pooling? ICCV 2021
GDP: Stabilized Neural Network Pruning via Gates With Differentiable Polarization ICCV 2021
Reliably Fast Adversarial Training via Latent Adversarial Perturbation ICCV 2021
Sub-Bit Neural Networks: Learning To Compress and Accelerate Binary Neural Networks ICCV 2021
NAS-OoD: Neural Architecture Search for Out-of-Distribution Generalization ICCV 2021
Reverse engineering learned optimizers reveals known and novel mechanisms NIPS 2021
WGAN with an Infinitely Wide Generator Has No Spurious Stationary Points ICML 2021
Scaling Laws for Acoustic Models INTERSPEECH 2021
Accelerating Continuous Normalizing Flow with Trajectory Polynomial Regularization AAAI 2021
The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models IJCNLP 2021
When Are Solutions Connected in Deep Networks? NIPS 2021
Log-Likelihood-Ratio Cost Function as Objective Loss for Speaker Verification Systems INTERSPEECH 2021
On the Importance of Hyperparameter Optimization for Model-based Reinforcement Learning AISTATS 2021
Retinex-Inspired Unrolling With Cooperative Prior Architecture Search for Low-Light Image Enhancement CVPR 2021
An Improved Single Step Non-Autoregressive Transformer for Automatic Speech Recognition INTERSPEECH 2021
Bag of Tricks for Optimizing Transformer Efficiency EMNLP 2021
Learning With Privileged Tasks ICCV 2021
Blending Anti-Aliasing into Vision Transformer NIPS 2021
AdderSR: Towards Energy Efficient Image Super-Resolution CVPR 2021
TANDEM: Tracking and Dense Mapping in Real-time using Deep Multi-view Stereo CORL 2021
Learned Robust PCA: A Scalable Deep Unfolding Approach for High-Dimensional Outlier Detection NIPS 2021