Neural Network Optimization

DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models ICLR 2024 Domain-Inspired Sharpness-Aware Minimization Under Domain Shifts ICLR 2024 Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity EMNLP 2024 DropBP: Accelerating Fine-Tuning of Large Language Models by Dropping Backward Propagation NeurIPS 2024 DSD²: Can We Dodge Sparse Double Descent and Compress the Neural Network Worry-Free? AAAI 2024 Dual Cone Gradient Descent for Training Physics-Informed Neural Networks NeurIPS 2024 Dual Prior Unfolding for Snapshot Compressive Imaging CVPR 2024 Dynamic Masking Rate Schedules for MLM Pretraining EACL 2024 Dynamic Neural Regeneration: Enhancing Deep Learning Generalization on Small Datasets NeurIPS 2024 Dynamic Rescaling for Training GNNs NeurIPS 2024 E2-LLM: Efficient and Extreme Length Extension of Large Language Models ACL 2024 Efficiency Calibration of Implicit Regularization in Deep Networks via Self-paced Curriculum-Driven Singular Value Selection IJCAI 2024 Efficient Error Certification for Physics-Informed Neural Networks ICML 2024 Efficient Federated Learning against Heterogeneous and Non-stationary Client Unavailability NeurIPS 2024 Efficiently Learning One-Hidden-Layer ReLU Networks via SchurPolynomials COLT 2024 Efficiently Train ASR Models that Memorize Less and Perform Better with Per-core Clipping Interspeech 2024 Efficient Reinforcement Learning by Discovering Neural Pathways NeurIPS 2024 Efficient Sign-Based Optimization: Accelerating Convergence via Variance Reduction NeurIPS 2024 EFTNAS: Searching for Efficient Language Models in First-Order Weight-Reordered Super-Networks COLING 2024 EG-NAS: Neural Architecture Search with Fast Evolutionary Exploration AAAI 2024 ElasticAST: An Audio Spectrogram Transformer for All Length and Resolutions Interspeech 2024 Encodings for Prediction-based Neural Architecture Search ICML 2024 End-to-End Phase Field Model Discovery Combining Experimentation, Crowdsourcing, Simulation and Learning AAAI 2024 End-to-End Temporal Action Detection with 1B Parameters Across 1000 Frames CVPR 2024 Enhancing Adversarial Robustness in SNNs with Sparse Gradients ICML 2024