Optimization & Theory

The role of optimization geometry in single neuron learning AISTATS 2022 The RoyalFlush System for the WMT 2022 Efficiency Task EMNLP 2022 The Sample Complexity of One-Hidden-Layer Neural Networks NeurIPS 2022 The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models NeurIPS 2022 The State of Sparse Training in Deep Reinforcement Learning ICML 2022 The trade-offs of model size in large recommendation models : 100GB to 10MB Criteo-tb DLRM model NeurIPS 2022 Three-stage Evolution and Fast Equilibrium for SGD with Non-degerate Critical Points ICML 2022 Thrifty Neural Architecture Search for Medical Image Segmentation (Student Abstract) AAAI 2022 Tight Neural Network Verification via Semidefinite Relaxations and Linear Reformulations AAAI 2022 To Fold or Not to Fold: a Necessary and Sufficient Condition on Batch-Normalization Layers Folding IJCAI 2022 Token and Head Adaptive Transformers for Efficient Natural Language Processing COLING 2022 Token Dropping for Efficient BERT Pretraining ACL 2022 Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering Evaluation EMNLP 2022 Too Brittle to Touch: Comparing the Stability of Quantization and Distillation towards Developing Low-Resource MT Models EMNLP 2022 Topologically-Aware Deformation Fields for Single-View 3D Reconstruction CVPR 2022 Topology-aware Generalization of Decentralized SGD ICML 2022 Topology-Aware Network Pruning using Multi-stage Graph Embedding and Reinforcement Learning ICML 2022 To update or not to update? Neurons at equilibrium in deep models NeurIPS 2022 Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis NeurIPS 2022 Toward Low-Cost End-to-End Spoken Language Understanding Interspeech 2022 Toward Robust Spiking Neural Network Against Adversarial Perturbation NeurIPS 2022 Towards an Effective Orthogonal Dictionary Convolution Strategy AAAI 2022 Towards Better Plasticity-Stability Trade-Off in Incremental Learning: A Simple Linear Connector CVPR 2022 Towards Better Understanding Attribution Methods CVPR 2022 Towards Bridging Sample Complexity and Model Capacity AAAI 2022