conftrace_

activation normalization

7 papers

Explore in graph

Co-occurring keywords

batch normalization (222) neural network optimization (1293) outlier feature (2) weight normalization (26) prediction confidence (13) generative network (50) gradient explosion (8) contrastive search (5) preconditioning optimizer (1) penultimate activation (2)

Papers

Cluster-Norm for Unsupervised Probing of Knowledge EMNLP 2024
Understanding and Minimising Outlier Features in Transformer Training NIPS 2024
Domain Adaptation with Adversarial Training on Penultimate Activations AAAI 2023
Constrained Weight Optimization for Learning Without Activation Normalization WACV 2021
Positional Normalization NIPS 2019
Decorrelated Batch Normalization CVPR 2018
Regularizing by the Variance of the Activations' Sample-Variances NIPS 2018