conftrace_
← Deep Learning
Deep Learning ›

Optimization & Theory

6,829 papers (27 classified directly here)

Subtopics

Model Compression (1,785) Optimization (1,664) Efficient Computing (1,579) Theory (1,082) Neural Network Optimization (903) Evaluation (509) Loss Functions (123) Interpretability (105) Stochastic Methods (97) Regularization (77) Generalization (24) Sparse Optimization (7)

Papers per year

8
50
642
1173
'10
'15
'20
'25

Papers (including subtopics)

Traversing Between Modes in Function Space for Fast Ensembling ICML 2023
KDEformer: Accelerating Transformers via Kernel Density Estimation ICML 2023
Stabilizing Transformer Training by Preventing Attention Entropy Collapse ICML 2023
Effective Minkowski Dimension of Deep Nonparametric Regression: Function Approximation and Statistical Theories ICML 2023
On Enhancing Expressive Power via Compositions of Single Fixed-Size ReLU Network ICML 2023
Bi-directional Masks for Efficient N:M Sparse Training ICML 2023
Optimal Shrinkage for Distributed Second-Order Optimization ICML 2023
Provable Dynamic Fusion for Low-Quality Multimodal Data ICML 2023
Nearly-tight Bounds for Deep Kernel Learning ICML 2023
Rockmate: an Efficient, Fast, Automatic and Generic Tool for Re-materialization in PyTorch ICML 2023
Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEs ICML 2023
Decentralized SGD and Average-direction SAM are Asymptotically Equivalent ICML 2023
Benign Overfitting in Deep Neural Networks under Lazy Training ICML 2023
spred: Solving L1 Penalty with SGD ICML 2023
Some Might Say All You Need Is Sum IJCAI 2023
Calibrating a Deep Neural Network with Its Predecessors IJCAI 2023
Singularformer: Learning to Decompose Self-Attention to Linearize the Complexity of Transformer IJCAI 2023
Fast-StrucTexT: An Efficient Hourglass Transformer with Modality-guided Dynamic Token Merge for Document Understanding IJCAI 2023
Efficient Global Robustness Certification of Neural Networks via Interleaving Twin-Network Encoding (Extended Abstract) IJCAI 2023
Towards Fully Quantized Neural Networks For Speech Enhancement INTERSPEECH 2023
Scaling Laws for Discriminative Speech Recognition Rescoring Models INTERSPEECH 2023
Delay-penalized CTC Implemented Based on Finite State Transducer INTERSPEECH 2023
Blank Collapse: Compressing CTC Emission for the Faster Decoding INTERSPEECH 2023
Accelerating Transducers through Adjacent Token Merging INTERSPEECH 2023
A Binary Keyword Spotting System with Error-Diffusion Based Feature Binarization INTERSPEECH 2023