Neural Network Optimization

DAdEE: Unsupervised Domain Adaptation in Early Exit PLMs EMNLP 2024 DAPE: Data-Adaptive Positional Encoding for Length Extrapolation NeurIPS 2024 DASH: Warm-Starting Neural Network Training in Stationary Settings without Loss of Plasticity NeurIPS 2024 Data Driven Threshold and Potential Initialization for Spiking Neural Networks AISTATS 2024 Data-Efficient Learning with Neural Programs NeurIPS 2024 Deconstructing the Goldilocks Zone of Neural Network Initialization ICML 2024 Deep Equilibrium Algorithmic Reasoning NeurIPS 2024 Deep Fusion: Efficient Network Training via Pre-trained Initializations ICML 2024 Deep Learning for Computing Convergence Rates of Markov Chains NeurIPS 2024 Deep linear networks for regression are implicitly regularized towards flat minima NeurIPS 2024 Deep model-free KKL observer: A switching approach L4DC 2024 Deep-TROJ: An Inference Stage Trojan Insertion Algorithm through Efficient Weight Replacement Attack CVPR 2024 DeepZero: Scaling Up Zeroth-Order Optimization for Deep Model Training ICLR 2024 DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging NeurIPS 2024 Depth-Wise Attention (DWAtt): A Layer Fusion Method for Data-Efficient Classification COLING 2024 DET: A Dual-Encoding Transformer for Relational Graph Embedding COLING 2024 DFA-GNN: Forward Learning of Graph Neural Networks by Direct Feedback Alignment NeurIPS 2024 DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion NeurIPS 2024 Diagonalisation SGD: Fast & Convergent SGD for Non-Differentiable Models via Reparameterisation and Smoothing AISTATS 2024 Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking ICLR 2024 Dictionary Contrastive Learning for Efficient Local Supervision without Auxiliary Networks ICLR 2024 Differentiable Model Scaling using Differentiable Topk ICML 2024 DiffLoc: Diffusion Model for Outdoor LiDAR Localization CVPR 2024 Diffusion Models Without Attention CVPR 2024 Dissecting the Interplay of Attention Paths in a Statistical Mechanics Theory of Transformers NeurIPS 2024