Optimization & Theory

SP2 : A Second Order Stochastic Polyak Method ICLR 2023 SparseGPT: Massive Language Models Can be Accurately Pruned in One-Shot ICML 2023 Sparse Low-rank Adaptation of Pre-trained Language Models EMNLP 2023 SparseProp: Efficient Sparse Backpropagation for Faster Training of Neural Networks at the Edge ICML 2023 Sparse Training with Lipschitz Continuous Loss Functions and a Weighted Group L0-norm Constraint JMLR 2023 Sparse Universal Transformer EMNLP 2023 SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer CVPR 2023 SparseVSR: Lightweight and Noise Robust Visual Speech Recognition Interspeech 2023 Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers CVPR 2023 Sparsity-aware generalization theory for deep neural networks COLT 2023 Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation EMNLP 2023 Speculative Decoding with Big Little Decoder NeurIPS 2023 SpENCNN: Orchestrating Encoding and Sparsity for Fast Homomorphically Encrypted Neural Network Inference ICML 2023 Spider GAN: Leveraging Friendly Neighbors To Accelerate GAN Training CVPR 2023 SplineCam: Exact Visualization and Characterization of Deep Network Geometry and Decision Boundaries CVPR 2023 Spread Flows for Manifold Modelling AISTATS 2023 spred: Solving L1 Penalty with SGD ICML 2023 Spurious Valleys and Clustering Behavior of Neural Networks ICML 2023 SQAD: Automatic Smartphone Camera Quality Assessment and Benchmarking ICCV 2023 Stabilizing Transformer Training by Preventing Attention Entropy Collapse ICML 2023 Stable Nonconvex-Nonconcave Training via Linear Interpolation NeurIPS 2023 STAR Loss: Reducing Semantic Ambiguity in Facial Landmark Detection CVPR 2023 Steganography of Steganographic Networks AAAI 2023 STEP: Learning N:M Structured Sparsity Masks from Scratch with Precondition ICML 2023 Stochastic Bridges as Effective Regularizers for Parameter-Efficient Tuning ACL 2023