Neural Network Optimization

Memorization and Optimization in Deep Neural Networks with Minimum Over-parameterization NeurIPS 2022 Modality-specific Learning Rates for Effective Multimodal Additive Late-fusion ACL 2022 Multi-Level Firing with Spiking DS-ResNet: Enabling Better and Deeper Directly-Trained Spiking Neural Networks IJCAI 2022 NAS-VAD: Neural Architecture Search for Voice Activity Detection Interspeech 2022 NeuralArTS: Structuring Neural Architecture Search with Type Theory (Student Abstract) AAAI 2022 Neural Deep Equilibrium Solvers ICLR 2022 Neural Networks Classify through the Class-Wise Means of Their Representations AAAI 2022 No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models ICLR 2022 NSGZero: Efficiently Learning Non-exploitable Policy in Large-Scale Network Security Games with Neural Monte Carlo Tree Search AAAI 2022 Old can be Gold: Better Gradient Flow can Make Vanilla-GCNs Great Again NeurIPS 2022 On global convergence of ResNets: From finite to infinite width using linear parameterization NeurIPS 2022 On the Double Descent of Random Features Models Trained with SGD NeurIPS 2022 On the Parameterization and Initialization of Diagonal State Space Models NeurIPS 2022 Optimization-Based Separations for Neural Networks COLT 2022 Optimized Potential Initialization for Low-Latency Spiking Neural Networks AAAI 2022 Orthogonal Graph Neural Networks AAAI 2022 PATS: Sensitivity-aware Noisy Learning for Pretrained Language Models EMNLP 2022 Penalizing Gradient Norm for Efficiently Improving Generalization in Deep Learning ICML 2022 Power-Law Escape Rate of SGD ICML 2022 Prior Gradient Mask Guided Pruning-Aware Fine-Tuning AAAI 2022 Probing via Prompting NAACL 2022 Proximal PanNet: A Model-Based Deep Network for Pansharpening AAAI 2022 Prune and Tune Ensembles: Low-Cost Ensemble Learning with Sparse Independent Subnetworks AAAI 2022 QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detection CVPR 2022 Reflash Dropout in Image Super-Resolution CVPR 2022