neural network optimization

Batch Normalization Is Blind to the First and Second Derivatives of the Loss AAAI 2024 Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis ICLR 2024 BMRS: Bayesian Model Reduction for Structured Pruning NeurIPS 2024 BOLD: Boolean Logic Deep Learning NeurIPS 2024 Boosting Adversarial Transferability by Block Shuffle and Rotation CVPR 2024 Bounds for the smallest eigenvalue of the NTK for arbitrary spherical data of arbitrary dimension NeurIPS 2024 Bridging the Divide: Reconsidering Softmax and Linear Attention NeurIPS 2024 Bridging the Empirical-Theoretical Gap in Neural Network Formal Language Learning Using Minimum Description Length ACL 2024 Can we get the best of both Binary Neural Networks and Spiking Neural Networks for Efficient Computer Vision? ICLR 2024 Causality-enhanced Discreted Physics-informed Neural Networks for Predicting Evolutionary Equations IJCAI 2024 Clarifying the Behavior and the Difficulty of Adversarial Training AAAI 2024 Collaboration! Towards Robust Neural Methods for Routing Problems NeurIPS 2024 CR-SAM: Curvature Regularized Sharpness-Aware Minimization AAAI 2024 Data Driven Threshold and Potential Initialization for Spiking Neural Networks AISTATS 2024 Data-independent Module-aware Pruning for Hierarchical Vision Transformers ICLR 2024 DATS: Difficulty-Aware Task Sampler for Meta-Learning Physics-Informed Neural Networks ICLR 2024 DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging NeurIPS 2024 DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning ICLR 2024 Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking ICLR 2024 Differentiable Learning of Generalized Structured Matrices for Efficient Deep Neural Networks ICLR 2024 DiffLoc: Diffusion Model for Outdoor LiDAR Localization CVPR 2024 DIMAT: Decentralized Iterative Merging-And-Training for Deep Learning Models CVPR 2024 DiP-GO: A Diffusion Pruner via Few-step Gradient Optimization NeurIPS 2024 DISP-LLM: Dimension-Independent Structural Pruning for Large Language Models NeurIPS 2024 DropBP: Accelerating Fine-Tuning of Large Language Models by Dropping Backward Propagation NeurIPS 2024