conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

IrEne: Interpretable Energy Prediction for Transformers ACL 2021
Learning Modulated Loss for Rotated Object Detection AAAI 2021
Ada-Segment: Automated Multi-loss Adaptation for Panoptic Segmentation AAAI 2021
Improving Gradient Flow with Unrolled Highway Expectation Maximization AAAI 2021
A Compression-Compilation Co-Design Framework Towards Real-Time Object Detection on Mobile Devices AAAI 2021
Learning to Cascade: Confidence Calibration for Improving the Accuracy and Computational Cost of Cascade Inference Systems AAAI 2021
DeepReDuce: ReLU Reduction for Fast Private Inference ICML 2021
Multiplicative Noise and Heavy Tails in Stochastic Optimization ICML 2021
Align, then memorise: the dynamics of learning with feedback alignment ICML 2021
Attention is not all you need: pure attention loses rank doubly exponentially with depth ICML 2021
THOR, Trace-based Hardware-driven Layer-Oriented Natural Gradient Descent Computation AAAI 2021
Stochastic Attention Head Removal: A Simple and Effective Method for Improving Transformer Based ASR Models INTERSPEECH 2021
Loss Surface Simplexes for Mode Connecting Volumes and Fast Ensembling ICML 2021
Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Bounds NIPS 2021
DPFPS: Dynamic and Progressive Filter Pruning for Compressing Convolutional Neural Networks from Scratch AAAI 2021
Revisiting Weight Initialization of Deep Neural Networks ACML 2021
Does Preprocessing Help Training Over-parameterized Neural Networks? NIPS 2021
The Flip Side of the Reweighted Coin: Duality of Adaptive Dropout and Regularization NIPS 2021
EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation EMNLP 2021
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach EMNLP 2021
Bit-Mixer: Mixed-Precision Networks With Runtime Bit-Width Selection ICCV 2021
Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depth ICML 2021
Nondeterminism and Instability in Neural Network Optimization ICML 2021
Improving Gradient Regularization using Complex-Valued Neural Networks ICML 2021
An Optimistic Acceleration of AMSGrad for Nonconvex Optimization ACML 2021