conftrace_
← Deep Learning
Deep Learning ›

Optimization & Theory

6,829 papers (27 classified directly here)

Subtopics

Model Compression (1,785) Optimization (1,664) Efficient Computing (1,579) Theory (1,082) Neural Network Optimization (903) Evaluation (509) Loss Functions (123) Interpretability (105) Stochastic Methods (97) Regularization (77) Generalization (24) Sparse Optimization (7)

Papers per year

8
50
642
1173
'10
'15
'20
'25

Papers (including subtopics)

SKFAC: Training Neural Networks With Faster Kronecker-Factored Approximate Curvature CVPR 2021
MoViNets: Mobile Video Networks for Efficient Video Recognition CVPR 2021
Multi-split Reversible Transformers Can Enhance Neural Machine Translation EACL 2021
Conditional Poisson Stochastic Beams EMNLP 2021
Learning Compact Metrics for MT EMNLP 2021
Disentangling Representations of Text by Masking Transformers EMNLP 2021
Ultra-High Dimensional Sparse Representations with Binarization for Efficient Text Retrieval EMNLP 2021
Certified Robustness to Programmable Transformations in LSTMs EMNLP 2021
Shortcutted Commonsense: Data Spuriousness in Deep Learning of Commonsense Reasoning EMNLP 2021
Debiasing Methods in Natural Language Understanding Make Bias More Accessible EMNLP 2021
Effects of Parameter Norm Growth During Transformer Training: Inductive Bias from Gradient Descent EMNLP 2021
We Need to Talk About train-dev-test Splits EMNLP 2021
Data and Parameter Scaling Laws for Neural Machine Translation EMNLP 2021
Sparse Attention with Linear Units EMNLP 2021
Towards Zero-Shot Knowledge Distillation for Natural Language Processing EMNLP 2021
Improving Multilingual Translation by Representation and Gradient Regularization EMNLP 2021
Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language Generation EMNLP 2021
MATE: Multi-view Attention for Table Transformer Efficiency EMNLP 2021
When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute EMNLP 2021
Universal-KD: Attention-based Output-Grounded Intermediate Layer Knowledge Distillation EMNLP 2021
Understanding and Overcoming the Challenges of Efficient Transformer Quantization EMNLP 2021
Sequence Length is a Domain: Length-based Overfitting in Transformer Models EMNLP 2021
Efficient Inference for Multilingual Neural Machine Translation EMNLP 2021
What happens if you treat ordinal ratings as interval data? Human evaluations in NLP are even more under-powered than you think EMNLP 2021
Sparsity and Sentence Structure in Encoder-Decoder Attention of Summarization Systems EMNLP 2021