conftrace_
← Deep Learning
Deep Learning ›

Techniques

8,241 papers (36 classified directly here)

Subtopics

Model Architecture (4,354) Pretraining (2,483) Attention (1,111) Normalization (341) Attention Mechanism (150)

Papers per year

4
30
847
998
'10
'15
'20
'25

Papers (including subtopics)

Hard-Attention for Scalable Image Classification NIPS 2021
Structured Dropout Variational Inference for Bayesian Neural Networks NIPS 2021
Efficient Neural Network Training via Forward and Backward Propagation Sparsification NIPS 2021
Augmented Shortcuts for Vision Transformers NIPS 2021
Transformer in Transformer NIPS 2021
CAPE: Encoding Relative Positions with Continuous Augmented Positional Embeddings NIPS 2021
Deformable Butterfly: A Highly Structured and Sparse Linear Transform NIPS 2021
Rethinking the Pruning Criteria for Convolutional Neural Network NIPS 2021
Learning with Algorithmic Supervision via Continuous Relaxations NIPS 2021
Global-aware Beam Search for Neural Abstractive Summarization NIPS 2021
Sparse Steerable Convolutions: An Efficient Learning of SE(3)-Equivariant Features for Estimation and Tracking of Object Poses in 3D Space NIPS 2021
Graph Differentiable Architecture Search with Structure Learning NIPS 2021
Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence NIPS 2021
Relaxing Local Robustness NIPS 2021
Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer NIPS 2021
Dense Keypoints via Multiview Supervision NIPS 2021
Scatterbrain: Unifying Sparse and Low-rank Attention NIPS 2021
Structured Denoising Diffusion Models in Discrete State-Spaces NIPS 2021
Supervising the Transfer of Reasoning Patterns in VQA NIPS 2021
Fast Certified Robust Training with Short Warmup NIPS 2021
Revisiting Deep Learning Models for Tabular Data NIPS 2021
Unfolding Taylor's Approximations for Image Restoration NIPS 2021
Only Train Once: A One-Shot Neural Network Training And Pruning Framework NIPS 2021
Boost Neural Networks by Checkpoints NIPS 2021
Chasing Sparsity in Vision Transformers: An End-to-End Exploration NIPS 2021