Optimization & Theory

Where do Models go Wrong? Parameter-Space Saliency Maps for Explainability NeurIPS 2022 Whitening Convergence Rate of Coupling-based Normalizing Flows NeurIPS 2022 Who Says Elephants Can’t Run: Bringing Large Scale MoE Models into Cloud Scale Production EMNLP 2022 Why neural networks find simple solutions: The many regularizers of geometric complexity NeurIPS 2022 Why Robust Generalization in Deep Learning is Difficult: Perspective of Expressive Power NeurIPS 2022 Width is Less Important than Depth in ReLU Neural Networks COLT 2022 Winning the Lottery Ahead of Time: Efficient Early Network Pruning ICML 2022 XDoc: Unified Pre-training for Cross-Format Document Understanding EMNLP 2022 XPrompt: Exploring the Extreme of Prompt Tuning EMNLP 2022 Your Transformer May Not be as Powerful as You Expect NeurIPS 2022 ZARTS: On Zero-order Optimization for Neural Architecture Search NeurIPS 2022 ZeroFL: Efficient On-Device Training for Federated Learning with Local Sparsity ICLR 2022 Zero-Shot Dynamic Quantization for Transformer Inference EMNLP 2022 Zero Stability Well Predicts Performance of Convolutional Neural Networks AAAI 2022 Zonotope Domains for Lagrangian Neural Network Verification NeurIPS 2022 α-IoU: A Family of Power Intersection over Union Losses for Bounding Box Regression NeurIPS 2021 1-bit Adam: Communication Efficient Large-Scale Training with Adam’s Convergence Speed ICML 2021 2D or not 2D? Adaptive 3D Convolution Selection for Efficient Video Recognition CVPR 2021 3D CNNs With Adaptive Temporal Feature Resolutions CVPR 2021 Accelerate CNNs from Three Dimensions: A Comprehensive Pruning Framework ICML 2021 Accelerating Continuous Normalizing Flow with Trajectory Polynomial Regularization AAAI 2021 Accelerating Ill-Conditioned Low-Rank Matrix Estimation via Scaled Gradient Descent JMLR 2021 Accelerating Neural Machine Translation with Partial Word Embedding Compression AAAI 2021 Acceleration via Fractal Learning Rate Schedules ICML 2021 Accurate Post Training Quantization With Small Calibration Sets ICML 2021