relu activation

ReLUPruner: Rethinking ReLU Importance with Taylor Expansion for Efficient Private Inference AAAI 2026 Loss Landscape of Shallow ReLU-like Neural Networks: Stationary Points, Saddle Escape, and Network Embedding ICLR 2025 Posterior and Variational Inference for Deep Neural Networks with Heavy-Tailed Weights JMLR 2025 Self-Normalized Resets for Plasticity in Continual Learning ICLR 2025 Sparsing Law: Towards Large Language Models with Greater Activation Sparsity ICML 2025 Training One-Dimensional Graph Neural Networks is NP-Hard ICLR 2025 A faster and simpler algorithm for learning shallow networks COLT 2024 A Sublinear Adversarial Training Algorithm ICLR 2024 Disparate Impact on Group Accuracy of Linearization for Private Inference ICML 2024 Generalizing Orthogonalization for Models with Non-Linearities ICML 2024 Hamiltonian Monte Carlo on ReLU Neural Networks is Inefficient NeurIPS 2024 How does PDE order affect the convergence of PINNs? NeurIPS 2024 Improving Lipschitz-Constrained Neural Networks by Learning Activation Functions JMLR 2024 On the Effect of Initialization: The Scaling Path of 2-Layer Neural Networks JMLR 2024 Symmetric Neural-Collapse Representations with Supervised Contrastive Loss: The Impact of ReLU and Batching ICLR 2024 Task structure and nonlinearity jointly determine learned representational geometry ICLR 2024 The Inhibitor: ReLU and Addition-Based Attention for Efficient Transformers (Student Abstract) AAAI 2024 Topological obstruction to the training of shallow ReLU neural networks NeurIPS 2024 Benign Overfitting in Deep Neural Networks under Lazy Training ICML 2023 Benign Overfitting in Two-layer ReLU Convolutional Neural Networks ICML 2023 Does a sparse ReLU network training problem always admit an optimum ? NeurIPS 2023 Exact Verification of ReLU Neural Control Barrier Functions NeurIPS 2023 Kernel Logistic Regression Approximation of an Understandable ReLU Neural Network ICML 2023 Learning Narrow One-Hidden-Layer ReLU Networks COLT 2023 Mnemonist: Locating Model Parameters that Memorize Training Examples UAI 2023