Normalization

Two Sides of Miscalibration: Identifying Over and Under-Confidence Prediction for Network Calibration UAI 2023 ViBid: Linear Vision Transformer with Bidirectional Normalization UAI 2023 Accelerating training of batch normalization: A manifold perspective UAI 2022 AD-DROP: Attribution-Driven Dropout for Robust Language Model Fine-Tuning NeurIPS 2022 Adversarially Robust Conformal Prediction ICLR 2022 A Loss Curvature Perspective on Training Instabilities of Deep Learning Models ICLR 2022 An Attention-Based Method for Guiding Attribute-Aligned Speech Representation Learning Interspeech 2022 A Spectral Perspective of DNN Robustness to Label Noise AISTATS 2022 A Unified Weight Initialization Paradigm for Tensorial Convolutional Neural Networks ICML 2022 Batch Normalization Preconditioning for Neural Network Training JMLR 2022 Be Like Water: Adaptive Floating Point for Machine Learning ICML 2022 Constructing Orthogonal Convolutions in an Explicit Manner ICLR 2022 Continual Normalization: Rethinking Batch Normalization for Online Continual Learning ICLR 2022 Cross-Domain Collaborative Normalization via Structural Knowledge AAAI 2022 Deep Sparse Conformer for Speech Recognition Interspeech 2022 Delving Into the Estimation Shift of Batch Normalization in a Network CVPR 2022 Demystifying Batch Normalization in ReLU Networks: Equivalent Convex Optimization Models and Implicit Regularization ICLR 2022 Discrete Representations Strengthen Vision Transformer Robustness ICLR 2022 Divisive Feature Normalization Improves Image Recognition Performance in AlexNet ICLR 2022 Domain Generalization with Relaxed Instance Frequency-wise Normalization for Multi-device Acoustic Scene Classification Interspeech 2022 DropCov: A Simple yet Effective Method for Improving Deep Architectures NeurIPS 2022 DropMix: A Textual Data Augmentation Combining Dropout with Mixup EMNLP 2022 Dynamic Token Normalization improves Vision Transformers ICLR 2022 Existence, Stability and Scalability of Orthogonal Convolutional Neural Networks JMLR 2022 Fractional Adaptive Linear Units AAAI 2022