Neural Network Optimization

Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent NeurIPS 2024 Passive Snapshot Coded Aperture Dual-Pixel RGB-D Imaging CVPR 2024 PDE+: Enhancing Generalization via PDE with Adaptive Distributional Diffusion AAAI 2024 Personalized Abstractive Summarization by Tri-agent Generation Pipeline EACL 2024 PFCA-Net: Pyramid Feature Fusion and Cross Content Attention Network for Automated Audio Captioning Interspeech 2024 Physics-Informed Neural Networks: Minimizing Residual Loss with Wide Networks and Effective Activations IJCAI 2024 PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training ICLR 2024 Predictor-Corrector Enhanced Transformers with Exponential Moving Average Coefficient Learning NeurIPS 2024 Preparing Lessons for Progressive Training on Language Models AAAI 2024 PRES: Toward Scalable Memory-Based Dynamic Graph Neural Networks ICLR 2024 Pretraining with Random Noise for Fast and Robust Learning without Weight Transport NeurIPS 2024 Principled Architecture-aware Scaling of Hyperparameters ICLR 2024 Progressive Tuning: Towards Generic Sentiment Abilities for Large Language Models ACL 2024 PromptCoT: Align Prompt Distribution via Adapted Chain-of-Thought CVPR 2024 Provable Accelerated Convergence of Nesterov’s Momentum for Deep ReLU Neural Networks ALT 2024 Provable Acceleration of Nesterov's Accelerated Gradient for Asymmetric Matrix Factorization and Linear Neural Networks NeurIPS 2024 Provable Acceleration of Nesterov’s Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks IJCAI 2024 Provable Benefits of Local Steps in Heterogeneous Federated Learning for Neural Networks: A Feature Learning Perspective ICML 2024 Pruning From Scratch via Shared Pruning Module and Nuclear Norm-Based Regularization WACV 2024 PSC: Extending Context Window of Large Language Models via Phase Shift Calibration EMNLP 2024 PURE: Prompt Evolution with Graph ODE for Out-of-distribution Fluid Dynamics Modeling NeurIPS 2024 QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning EMNLP 2024 QLABGrad: A Hyperparameter-Free and Convergence-Guaranteed Scheme for Deep Learning AAAI 2024 QT-ViT: Improving Linear Attention in ViT with Quadratic Taylor Expansion NeurIPS 2024 Quadratic models for understanding catapult dynamics of neural networks ICLR 2024