neural network optimization

RNNs of RNNs: Recursive Construction of Stable Assemblies of Recurrent Neural Networks NeurIPS 2022 Robust High-Resolution Video Matting With Temporal Guidance WACV 2022 Scalable and Efficient Training of Large Convolutional Neural Networks with Differential Privacy NeurIPS 2022 Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments EMNLP 2022 SDQ: Stochastic Differentiable Quantization with Mixed Precision ICML 2022 SE(3) Equivariant Graph Neural Networks with Complete Local Frames ICML 2022 Sharpness-Aware Minimization Improves Language Model Generalization ACL 2022 Sharpness-Aware Minimization with Dynamic Reweighting EMNLP 2022 ShiftAddNAS: Hardware-Inspired Search for More Accurate and Efficient Neural Networks ICML 2022 Signal Recovery with Non-Expansive Generative Network Priors NeurIPS 2022 Smooth Maximum Unit: Smooth Activation Function for Deep Networks Using Smoothing Maximum Technique CVPR 2022 Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimation ICML 2022 Sparse Structure Search for Delta Tuning NeurIPS 2022 Spectral Bias in Practice: The Role of Function Frequency in Generalization NeurIPS 2022 Squashed Weight Distribution for Low Bit Quantization of Deep Models Interspeech 2022 Staged Training for Transformer Language Models ICML 2022 Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing NeurIPS 2022 Stochastic Adaptive Activation Function NeurIPS 2022 Structural Pruning via Latency-Saliency Knapsack NeurIPS 2022 The alignment property of SGD noise and how it helps select flat minima: A stability analysis NeurIPS 2022 The Hidden Convex Optimization Landscape of Regularized Two-Layer ReLU Networks: an Exact Characterization of Optimal Solutions ICLR 2022 The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains EMNLP 2022 The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models NeurIPS 2022 Three-stage Evolution and Fast Equilibrium for SGD with Non-degerate Critical Points ICML 2022 Tighter Sparse Approximation Bounds for ReLU Neural Networks ICLR 2022