neural network optimization

Width and Depth Limits Commute in Residual Networks ICML 2023 WLD-Reg: A Data-Dependent Within-Layer Diversity Regularizer AAAI 2023 YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors CVPR 2023 Accelerating DETR Convergence via Semantic-Aligned Matching CVPR 2022 Accelerating Sparse Convolution with Column Vector-Wise Sparsity NeurIPS 2022 A Closer Look at Learned Optimization: Stability, Robustness, and Inductive Biases NeurIPS 2022 A Closer Look at Smoothness in Domain Adversarial Training ICML 2022 A Closer Look at the Adversarial Robustness of Deep Equilibrium Models NeurIPS 2022 A Combinatorial Perspective on the Optimization of Shallow ReLU Networks NeurIPS 2022 A Communication-Efficient Distributed Gradient Clipping Algorithm for Training Deep Neural Networks NeurIPS 2022 Adam Can Converge Without Any Modification On Update Rules NeurIPS 2022 Advancing Model Pruning via Bi-level Optimization NeurIPS 2022 A Gentle Introduction to Deep Nets and Opportunities for the Future ACL 2022 AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models EMNLP 2022 AME: Attention and Memory Enhancement in Hyper-Parameter Optimization CVPR 2022 AMP: Automatically Finding Model Parallel Strategies with Heterogeneity Awareness NeurIPS 2022 Annihilation of Spurious Minima in Two-Layer ReLU Networks NeurIPS 2022 Anticipation-Free Training for Simultaneous Machine Translation ACL 2022 A Simple Hash-Based Early Exiting Approach For Language Understanding and Generation ACL 2022 A Solver + Gradient Descent Training Algorithm for Deep Neural Networks IJCAI 2022 Associated Learning: an Alternative to End-to-End Backpropagation that Works on CNN, RNN, and Transformer ICLR 2022 Attention Mechanism with Energy-Friendly Operations ACL 2022 Automated Progressive Learning for Efficient Training of Vision Transformers CVPR 2022 Beyond Cross-View Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image CVPR 2022 Brain-Inspired Multilayer Perceptron With Spiking Neurons CVPR 2022