conftrace_
← Deep Learning
Deep Learning ›

Techniques

8,241 papers (36 classified directly here)

Subtopics

Model Architecture (4,354) Pretraining (2,483) Attention (1,111) Normalization (341) Attention Mechanism (150)

Papers per year

4
30
847
998
'10
'15
'20
'25

Papers (including subtopics)

Dropout Reduces Underfitting ICML 2023
Reflected Diffusion Models ICML 2023
Mechanistic Mode Connectivity ICML 2023
Generative Pretraining for Black-Box Optimization ICML 2023
Reprogramming Pretrained Language Models for Antibody Sequence Infilling ICML 2023
Pruning via Sparsity-indexed ODE: a Continuous Sparsity Viewpoint ICML 2023
Input uncertainty propagation through trained neural networks ICML 2023
Achieving High Accuracy with PINNs via Energy Natural Gradient Descent ICML 2023
Equivariant Architectures for Learning in Deep Weight Spaces ICML 2023
Building Neural Networks on Matrix Manifolds: A Gyrovector Space Approach ICML 2023
SparseProp: Efficient Sparse Backpropagation for Faster Training of Neural Networks at the Edge ICML 2023
Few-bit Backward: Quantized Gradients of Activation Functions for Memory Footprint Reduction ICML 2023
How Many Perturbations Break This Model? Evaluating Robustness Beyond Adversarial Accuracy ICML 2023
Resurrecting Recurrent Neural Networks for Long Sequences ICML 2023
Reducing SO(3) Convolutions to SO(2) for Efficient Equivariant GNNs ICML 2023
Brauer’s Group Equivariant Neural Networks ICML 2023
How Jellyfish Characterise Alternating Group Equivariant Neural Networks ICML 2023
Hyena Hierarchy: Towards Larger Convolutional Language Models ICML 2023
Beam Tree Recursive Cells ICML 2023
Lowering the Pre-training Tax for Gradient-based Subset Training: A Lightweight Distributed Pre-Training Toolkit ICML 2023
SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient ICML 2023
Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistles ICML 2023
Complementary Attention for Multi-Agent Reinforcement Learning ICML 2023
Cross-Modal Fine-Tuning: Align then Refine ICML 2023
The Hessian perspective into the Nature of Convolutional Neural Networks ICML 2023