Optimization & Theory

Skip-Convolutions for Efficient Video Processing CVPR 2021 Slimmable Generative Adversarial Networks AAAI 2021 Slot Machines: Discovering Winning Combinations of Random Weights in Neural Networks ICML 2021 Slow Learning and Fast Inference: Efficient Graph Similarity Computation via Knowledge Distillation NeurIPS 2021 Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstruction NeurIPS 2021 Smoothness Matrices Beat Smoothness Constants: Better Communication Compression Techniques for Distributed Optimization NeurIPS 2021 Softmax Tree: An Accurate, Fast Classifier When the Number of Classes Is Large EMNLP 2021 SOFT: Softmax-free Transformer with Linear Complexity NeurIPS 2021 Space-Time Distillation for Video Super-Resolution CVPR 2021 SPADE: A Spectral Method for Black-Box Adversarial Robustness Evaluation ICML 2021 Sparse Attention with Linear Units EMNLP 2021 Sparse Deep Learning: A New Framework Immune to Local Traps and Miscalibration NeurIPS 2021 Sparse Flows: Pruning Continuous-depth Models NeurIPS 2021 Sparse linear networks with a fixed butterfly structure: theory and practice UAI 2021 Sparse Training via Boosting Pruning Plasticity with Neuroregeneration NeurIPS 2021 Sparsity and Sentence Structure in Encoder-Decoder Attention of Summarization Systems EMNLP 2021 Sparsity Aware Normalization for GANs AAAI 2021 Spatially-Adaptive Pixelwise Networks for Fast Image Translation CVPR 2021 Spectral Normalisation for Deep Reinforcement Learning: An Optimisation Perspective ICML 2021 Spectral Tensor Train Parameterization of Deep Learning Layers AISTATS 2021 Speeding Up Transformer Training By Using Dataset Subsampling - An Exploratory Analysis EMNLP 2021 Stability and Convergence of Stochastic Gradient Clipping: Beyond Lipschitz Continuity and Smoothness ICML 2021 Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks NeurIPS 2021 STAR: A Structure-Aware Lightweight Transformer for Real-Time Image Enhancement ICCV 2021 Stateful ODE-Nets using Basis Function Expansions NeurIPS 2021