Neural Network Optimization

G-NAS: Generalizable Neural Architecture Search for Single Domain Generalization Object Detection AAAI 2024 Gradient-based Parameter Selection for Efficient Fine-Tuning CVPR 2024 GradSafe: Detecting Jailbreak Prompts for LLMs via Safety-Critical Gradient Analysis ACL 2024 Great Minds Think Alike: The Universal Convergence Trend of Input Salience NeurIPS 2024 Grokking as the transition from lazy to rich training dynamics ICLR 2024 Harmony in Diversity: Merging Neural Networks with Canonical Correlation Analysis ICML 2024 Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models NeurIPS 2024 Heterogeneous Personalized Federated Learning by Local-Global Updates Mixing via Convergence Rate ICLR 2024 HGP-NLP at BioLaySumm: Leveraging LoRA for Lay Summarization of Biomedical Research Articles using Seq2Seq Transformers ACL 2024 HiFT: A Hierarchical Full Parameter Fine-Tuning Strategy EMNLP 2024 High-dimensional SGD aligns with emerging outlier eigenspaces ICLR 2024 High Probability Convergence Bounds for Non-convex Stochastic Gradient Descent with Sub-Weibull Noise JMLR 2024 HIVE: Harnessing Human Feedback for Instructional Visual Editing CVPR 2024 Hop, skip, jump to Convergence: Dynamics of Learning Rate Transitions for Improved Training of Large Language Models EMNLP 2024 How connectivity structure shapes rich and lazy learning in neural circuits ICLR 2024 How does Gradient Descent Learn Features --- A Local Analysis for Regularized Two-Layer Neural Networks NeurIPS 2024 How does PDE order affect the convergence of PINNs? NeurIPS 2024 How Graph Neural Networks Learn: Lessons from Training Dynamics ICML 2024 How Sparse Can We Prune A Deep Network: A Fundamental Limit Perspective NeurIPS 2024 How Two-Layer Neural Networks Learn, One (Giant) Step at a Time JMLR 2024 How Well Can a Genetic Algorithm Fine-tune Transformer Encoders? A First Approach NAACL 2024 Hyperbolic Optimizer as a Dynamical System ICML 2024 Hypergraph Dynamic System ICLR 2024 IAPT: Instance-Aware Prompt Tuning for Large Language Models ACL 2024 Identifying Equivalent Training Dynamics NeurIPS 2024