Optimization & Theory

SInGE: Sparsity via Integrated Gradients Estimation of Neuron Relevance NeurIPS 2022 SIREN: Shaping Representations for Detecting Out-of-Distribution Objects NeurIPS 2022 Size and depth of monotone neural networks: interpolation and approximation NeurIPS 2022 SizeShiftReg: a Regularization Method for Improving Size-Generalization in Graph Neural Networks NeurIPS 2022 Sketching as a Tool for Understanding and Accelerating Self-attention for Long Sequences NAACL 2022 Sketching based Representations for Robust Image Classification with Provable Guarantees NeurIPS 2022 SkipBERT: Efficient Inference with Shallow Layer Skipping ACL 2022 Slimmable Domain Adaptation CVPR 2022 SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages EMNLP 2022 SmartIdx: Reducing Communication Cost in Federated Learning by Exploiting the CNNs Structures AAAI 2022 Smooth Maximum Unit: Smooth Activation Function for Deep Networks Using Smoothing Maximum Technique CVPR 2022 Sobolev Acceleration and Statistical Optimality for Learning Elliptic Equations via Gradient Descent NeurIPS 2022 Softmax Bottleneck Makes Language Models Unable to Represent Multi-mode Word Distributions ACL 2022 SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters EMNLP 2022 Sparse Double Descent: Where Network Pruning Aggravates Overfitting ICML 2022 Sparse Instance Activation for Real-Time Instance Segmentation CVPR 2022 Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT EMNLP 2022 Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm ACL 2022 Sparse Structure Search for Delta Tuning NeurIPS 2022 Sparse Teachers Can Be Dense with Knowledge EMNLP 2022 Sparsifying Transformer Models with Trainable Representation Pooling ACL 2022 Spartan: Differentiable Sparsity via Regularized Transportation NeurIPS 2022 Spatial Pruned Sparse Convolution for Efficient 3D Object Detection NeurIPS 2022 Spectral Bias in Practice: The Role of Function Frequency in Generalization NeurIPS 2022 Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime NeurIPS 2022