conftrace_
← Deep Learning
Deep Learning ›

Optimization & Theory

6,829 papers (27 classified directly here)

Subtopics

Model Compression (1,785) Optimization (1,664) Efficient Computing (1,579) Theory (1,082) Neural Network Optimization (903) Evaluation (509) Loss Functions (123) Interpretability (105) Stochastic Methods (97) Regularization (77) Generalization (24) Sparse Optimization (7)

Papers per year

8
50
642
1173
'10
'15
'20
'25

Papers (including subtopics)

ProxyFusion: Face Feature Aggregation Through Sparse Experts NIPS 2024
Dual-Perspective Activation: Efficient Channel Denoising via Joint Forward-Backward Criterion for Artificial Neural Networks NIPS 2024
Boosting Generalization in Parametric PDE Neural Solvers through Adaptive Conditioning NIPS 2024
Counter-Current Learning: A Biologically Plausible Dual Network Approach for Deep Learning NIPS 2024
The Ladder in Chaos: Improving Policy Learning by Harnessing the Parameter Evolving Path in A Low-dimensional Space NIPS 2024
MetaLA: Unified Optimal Linear Approximation to Softmax Attention Map NIPS 2024
2DQuant: Low-bit Post-Training Quantization for Image Super-Resolution NIPS 2024
The Star Geometry of Critic-Based Regularizer Learning NIPS 2024
Even Sparser Graph Transformers NIPS 2024
Large Stepsize Gradient Descent for Non-Homogeneous Two-Layer Networks: Margin Improvement and Fast Optimization NIPS 2024
On the Inductive Bias of Stacking Towards Improving Reasoning NIPS 2024
FouRA: Fourier Low-Rank Adaptation NIPS 2024
Great Minds Think Alike: The Universal Convergence Trend of Input Salience NIPS 2024
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length NIPS 2024
Boosted Conformal Prediction Intervals NIPS 2024
Enriching Disentanglement: From Logical Definitions to Quantitative Metrics NIPS 2024
Universal In-Context Approximation By Prompting Fully Recurrent Models NIPS 2024
DISP-LLM: Dimension-Independent Structural Pruning for Large Language Models NIPS 2024
Physics-informed Neural Networks for Functional Differential Equations: Cylindrical Approximation and Its Convergence Guarantees NIPS 2024
ADOPT: Modified Adam Can Converge with Any $\beta_2$ with the Optimal Rate NIPS 2024
Tighter Convergence Bounds for Shuffled SGD via Primal-Dual Perspective NIPS 2024
Poseidon: Efficient Foundation Models for PDEs NIPS 2024
Integrating GNN and Neural ODEs for Estimating Non-Reciprocal Two-Body Interactions in Mixed-Species Collective Motion NIPS 2024
Dissecting the Interplay of Attention Paths in a Statistical Mechanics Theory of Transformers NIPS 2024
Symmetries in Overparametrized Neural Networks: A Mean Field View NIPS 2024