Neural Network Optimization

Improving Simultaneous Translation by Incorporating Pseudo-References with Fewer Reorderings EMNLP 2021 Incorporating Learnable Membrane Time Constant To Enhance Learning of Spiking Neural Networks ICCV 2021 Incremental Beam Manipulation for Natural Language Generation EACL 2021 Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting AAAI 2021 Initialization and Regularization of Factorized Neural Layers ICLR 2021 Intrinsic Dimension, Persistent Homology and Generalization in Neural Networks NeurIPS 2021 Joint-DetNAS: Upgrade Your Detector With NAS, Pruning and Dynamic Distillation CVPR 2021 Knowledge Evolution in Neural Networks CVPR 2021 Label Noise SGD Provably Prefers Flat Global Minimizers NeurIPS 2021 LambdaNetworks: Modeling long-range Interactions without Attention ICLR 2021 Large Batch Optimization for Deep Learning Using New Complete Layer-Wise Adaptive Rate Scaling AAAI 2021 Large Norms of CNN Layers Do Not Hurt Adversarial Robustness AAAI 2021 Large-Scale Meta-Learning with Continual Trajectory Shifting ICML 2021 LassoNet: A Neural Network with Feature Sparsity JMLR 2021 Last iterate convergence of SGD for Least-Squares in the Interpolation regime. NeurIPS 2021 Latent Equilibrium: A unified learning theory for arbitrarily fast computation with arbitrarily slow neurons NeurIPS 2021 Layerwise Optimization by Gradient Decomposition for Continual Learning CVPR 2021 Learned Initializations for Optimizing Coordinate-Based Neural Representations CVPR 2021 Learning A Minimax Optimizer: A Pilot Study ICLR 2021 Learning a Single Neuron with Bias Using Gradient Descent NeurIPS 2021 Learning by Turning: Neural Architecture Aware Optimisation ICML 2021 Learning Deeper Non-Monotonic Networks by Softly Transferring Solution Space IJCAI 2021 Learning Frequency Domain Approximation for Binary Neural Networks NeurIPS 2021 Learning Generalized Relational Heuristic Networks for Model-Agnostic Planning AAAI 2021 Learning Graph Neural Networks with Approximate Gradient Descent AAAI 2021