Neural Network Optimization

Quantifying the Hyperparameter Sensitivity of Neural Networks for Character-level Sequence-to-Sequence Tasks EACL 2024 Quantum Deep Equilibrium Models NeurIPS 2024 Quantum Recurrent Architectures for Text Classification EMNLP 2024 Random Scaling and Momentum for Non-smooth Non-convex Optimization ICML 2024 Random Sparse Lifts: Construction, Analysis and Convergence of finite sparse networks ICLR 2024 Real-Time Recurrent Learning using Trace Units in Reinforcement Learning NeurIPS 2024 Reasoning Paths Optimization: Learning to Reason and Explore From Diverse Paths EMNLP 2024 Recovering Labels from Local Updates in Federated Learning ICML 2024 Recurrent Complex-Weighted Autoencoders for Unsupervised Object Discovery NeurIPS 2024 Recurrent neural networks: vanishing and exploding gradients are not the end of the story NeurIPS 2024 Reducing Transformer Key-Value Cache Size with Cross-Layer Attention NeurIPS 2024 Regularized Adaptive Momentum Dual Averaging with an Efficient Inexact Subproblem Solver for Training Structured Neural Network NeurIPS 2024 Relational DNN Verification With Cross Executional Bound Refinement ICML 2024 ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models ICLR 2024 RepAn: Enhanced Annealing through Re-parameterization CVPR 2024 Reparameterized Importance Sampling for Robust Variational Bayesian Neural Networks ICML 2024 Reproducibility of predictive networks for mouse visual cortex NeurIPS 2024 RepTor: Re-parameterizable Temporal Convolution for Keyword Spotting via Differentiable Kernel Search Interspeech 2024 Resonance RoPE: Improving Context Length Generalization of Large Language Models ACL 2024 Resource-Efficient Transformer Pruning for Finetuning of Large Models CVPR 2024 Rethinking 3D Convolution in ℓ_p-norm Space NeurIPS 2024 Rethinking Human Motion Prediction with Symplectic Integral CVPR 2024 Rethinking Momentum Knowledge Distillation in Online Continual Learning ICML 2024 Rethinking Optimization and Architecture for Tiny Language Models ICML 2024 Rethinking the Flat Minima Searching in Federated Learning ICML 2024