Neural Network Optimization

Reliably Fast Adversarial Training via Latent Adversarial Perturbation ICCV 2021 Representation Costs of Linear Neural Networks: Analysis and Design NeurIPS 2021 Reservoir Transformers ACL 2021 ResNEsts and DenseNEsts: Block-based DNN Models with Improved Representation Guarantees NeurIPS 2021 ResNet or DenseNet? Introducing Dense Shortcuts to ResNet WACV 2021 Rethinking Channel Dimensions for Efficient Model Design CVPR 2021 Retrieve and Revise: Improving Peptide Identification with Similar Mass Spectra AAAI 2021 Revealing the Structure of Deep Neural Networks via Convex Duality ICML 2021 Reverse engineering learned optimizers reveals known and novel mechanisms NeurIPS 2021 Revisiting Locally Supervised Learning: an Alternative to End-to-end Training ICLR 2021 Revisiting ResNets: Improved Training and Scaling Strategies NeurIPS 2021 Revisiting Weight Initialization of Deep Neural Networks ACML 2021 Ridge Regression with Over-parametrized Two-Layer Networks Converge to Ridgelet Spectrum AISTATS 2021 Robust Pruning at Initialization ICLR 2021 Role of Optimizer on Network Fine-tuning for Adversarial Robustness (Student Abstract) AAAI 2021 RPSRNet: End-to-End Trainable Rigid Point Set Registration Network Using Barnes-Hut 2D-Tree Representation CVPR 2021 Safety Assurance for Systems with Machine Learning Components AAAI 2021 Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot? NeurIPS 2021 SAPE: Spatially-Adaptive Progressive Encoding for Neural Optimization NeurIPS 2021 Scaled-YOLOv4: Scaling Cross Stage Partial Network CVPR 2021 Scaling Laws for Acoustic Models Interspeech 2021 Scaling Properties of Deep Residual Networks ICML 2021 Scaling-Up Robust Gradient Descent Techniques AAAI 2021 Scheduled Sampling Based on Decoding Steps for Neural Machine Translation EMNLP 2021 Searching by Generating: Flexible and Efficient One-Shot NAS With Architecture Generator CVPR 2021