Neural Network Optimization

Once for Both: Single Stage of Importance and Sparsity Search for Vision Transformer Compression CVPR 2024 On Convergence of Adam for Stochastic Optimization under Relaxed Assumptions NeurIPS 2024 OneBit: Towards Extremely Low-bit Large Language Models NeurIPS 2024 On Feature Learning in Structured State Space Models NeurIPS 2024 Only Strict Saddles in the Energy Landscape of Predictive Coding Networks? NeurIPS 2024 On the Inductive Bias of Stacking Towards Improving Reasoning NeurIPS 2024 On the Limitations of Fractal Dimension as a Measure of Generalization NeurIPS 2024 On the Use of Anchoring for Training Vision Models NeurIPS 2024 OptEx: Expediting First-Order Optimization with Approximately Parallelized Iterations NeurIPS 2024 Optical Flow Guided Tongue Trajectory Generation for Diffusion-based Acoustic to Articulatory Inversion Interspeech 2024 Optimal deep learning of holomorphic operators between Banach spaces NeurIPS 2024 Ordered Momentum for Asynchronous SGD NeurIPS 2024 P2D: Plug and Play Discriminator for Accelerating GAN Frameworks WACV 2024 PACE: Marrying generalization in PArameter-efficient fine-tuning with Consistency rEgularization NeurIPS 2024 PACE: Pacing Operator Learning to Accurate Optical Field Simulation for Complicated Photonic Devices NeurIPS 2024 Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent NeurIPS 2024 Physics-Informed Neural Networks: Minimizing Residual Loss with Wide Networks and Effective Activations IJCAI 2024 Pipeline Parallelism with Controllable Memory NeurIPS 2024 Post-Hoc Reversal: Are We Selecting Models Prematurely? NeurIPS 2024 Pretrained Transformer Efficiently Learns Low-Dimensional Target Functions In-Context NeurIPS 2024 Progressive Divide-and-Conquer via Subsampling Decomposition for Accelerated MRI CVPR 2024 Provable Acceleration of Nesterov's Accelerated Gradient for Asymmetric Matrix Factorization and Linear Neural Networks NeurIPS 2024 Provable Acceleration of Nesterov’s Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks IJCAI 2024 Provable Tempered Overfitting of Minimal Nets and Typical Nets NeurIPS 2024 PSC: Extending Context Window of Large Language Models via Phase Shift Calibration EMNLP 2024