Neural Network Optimization

PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategies NeurIPS 2022 PokeBNN: A Binary Pursuit of Lightweight Accuracy CVPR 2022 Pooling Revisited: Your Receptive Field Is Suboptimal CVPR 2022 Por Qué Não Utiliser Alla Språk? Mixed Training with Gradient Optimization in Few-Shot Cross-Lingual Transfer NAACL 2022 Power-Law Escape Rate of SGD ICML 2022 PPT: Pre-trained Prompt Tuning for Few-shot Learning ACL 2022 Predicting Attention Sparsity in Transformers ACL 2022 Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation? IJCAI 2022 Prior Gradient Mask Guided Pruning-Aware Fine-Tuning AAAI 2022 Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency ACL 2022 projUNN: efficient method for training deep networks with unitary matrices NeurIPS 2022 Proppo: a Message Passing Framework for Customizable and Composable Learning Algorithms NeurIPS 2022 Provable Acceleration of Heavy Ball beyond Quadratics for a Class of Polyak-Lojasiewicz Functions when the Non-Convexity is Averaged-Out ICML 2022 Provable Generalization of Overparameterized Meta-learning Trained with SGD NeurIPS 2022 Provable Learning-based Algorithm For Sparse Recovery ICLR 2022 Proving the Lottery Ticket Hypothesis for Convolutional Neural Networks ICLR 2022 Pruned RNN-T for fast, memory-efficient ASR training Interspeech 2022 Quadtree Attention for Vision Transformers ICLR 2022 RAGO: Recurrent Graph Optimizer for Multiple Rotation Averaging CVPR 2022 Rare Gems: Finding Lottery Tickets at Initialization NeurIPS 2022 Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare Token Embeddings ACL 2022 Real-Time Portrait Stylization on the Edge IJCAI 2022 Real-Valued Backpropagation is Unsuitable for Complex-Valued Neural Networks NeurIPS 2022 Reasoning over Hybrid Chain for Table-and-Text Open Domain Question Answering IJCAI 2022 Recent Advances on Neural Network Pruning at Initialization IJCAI 2022