Neural Network Optimization

Learning To Learn by Jointly Optimizing Neural Architecture and Weights CVPR 2022 Learning to Optimize: A Primer and A Benchmark JMLR 2022 Learning to Reason with Neural Networks: Generalization, Unseen Data and Boolean Measures NeurIPS 2022 Learning to Schedule Learning rate with Graph Neural Networks ICLR 2022 Less Is More: Pay Less Attention in Vision Transformers AAAI 2022 Linearity Grafting: Relaxed Neuron Pruning Helps Certifiable Robustness ICML 2022 LittleBird: Efficient Faster & Longer Transformer for Question Answering EMNLP 2022 Local Context-aware Self-attention for Continuous Sign Language Recognition Interspeech 2022 LocoProp: Enhancing BackProp via Local Loss Optimization AISTATS 2022 Long-range Sequence Modeling with Predictable Sparse Attention ACL 2022 Long-Term Visual Map Sparsification With Heterogeneous GNN CVPR 2022 Low-complex and Highly-performed Binary Residual Neural Network for Small-footprint Keyword Spotting Interspeech 2022 Low-Level Physiological Implications of End-to-End Learning for Speech Recognition Interspeech 2022 Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape AISTATS 2022 LTMD: Learning Improvement of Spiking Neural Networks with Learnable Thresholding Neurons and Moderate Dropout NeurIPS 2022 LyaNet: A Lyapunov Framework for Training Neural ODEs ICML 2022 M³ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design NeurIPS 2022 Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach NeurIPS 2022 Making Look-Ahead Active Learning Strategies Feasible with Neural Tangent Kernels NeurIPS 2022 Making SGD Parameter-Free COLT 2022 MAML and ANIL Provably Learn Representations ICML 2022 Masked Training of Neural Networks with Partial Gradients AISTATS 2022 Matching Learned Causal Effects of Neural Networks with Domain Priors ICML 2022 Memorization and Optimization in Deep Neural Networks with Minimum Over-parameterization NeurIPS 2022 Memory Augmented Optimizers for Deep Learning ICLR 2022