neural network optimization

Streamlining Speech Enhancement DNNs: an Automated Pruning Method Based on Dependency Graph with Advanced Regularized Loss Strategies Interspeech 2024 Structured Optimal Brain Pruning for Large Language Models EMNLP 2024 Structured Pruning for Large Language Models Using Coupled Components Elimination and Minor Fine-tuning NAACL 2024 SymILO: A Symmetry-Aware Learning Framework for Integer Linear Optimization NeurIPS 2024 Synergistic Patch Pruning for Vision Transformer: Unifying Intra- & Inter-Layer Patch Importance ICLR 2024 SynSP: Synergy of Smoothness and Precision in Pose Sequences Refinement CVPR 2024 Taxonomy Driven Fast Adversarial Training AAAI 2024 The effect of Leaky ReLUs on the training and generalization of overparameterized networks AISTATS 2024 The Empirical Impact of Neural Parameter Symmetries, or Lack Thereof NeurIPS 2024 The Expected Loss of Preconditioned Langevin Dynamics Reveals the Hessian Rank AAAI 2024 The Feature Speed Formula: a flexible approach to scale hyper-parameters of deep neural networks NeurIPS 2024 The Fine-Grained Complexity of Gradient Computation for Training Large Language Models NeurIPS 2024 The Impact of Depth on Compositional Generalization in Transformer Language Models NAACL 2024 The Impact of Initialization on LoRA Finetuning Dynamics NeurIPS 2024 The Ladder in Chaos: Improving Policy Learning by Harnessing the Parameter Evolving Path in A Low-dimensional Space NeurIPS 2024 The Marginal Value of Momentum for Small Learning Rate SGD ICLR 2024 Theoretical Characterisation of the Gauss Newton Conditioning in Neural Networks NeurIPS 2024 The Orthogonality of Weight Vectors: The Key Characteristics of Normalization and Residual Connections IJCAI 2024 The Price of Implicit Bias in Adversarially Robust Generalization NeurIPS 2024 The Road Less Scheduled NeurIPS 2024 The Role of Over-Parameterization in Machine Learning – the Good, the Bad, the Ugly AAAI 2024 Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions JMLR 2024 Topological Generalization Bounds for Discrete-Time Stochastic Optimization Algorithms NeurIPS 2024 Torque Based Structured Pruning for Deep Neural Network WACV 2024 Towards Better Structured Pruning Saliency by Reorganizing Convolution WACV 2024