Architectures
30,950 papers (33 classified directly here)
Subtopics · a paper can sit in several, so these overlap
Papers per year
2
3
15
13
18
17
27
39
43
74
94
221
536
912
1,611
2,559
3,004
3,504
3,729
4,021
4,550
4,519
1,439
'10
'15
'20
'25
Papers (including subtopics)
Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models
ICML 2024
Transformers Implement Functional Gradient Descent to Learn Non-Linear Functions In Context
ICML 2024
Transformers Learn to Achieve Second-Order Convergence Rates for In-Context Linear Regression
NeurIPS 2024
Transformers Learn Transition Dynamics when Trained to Predict Markov Decision Processes
EMNLP 2024
Transformers@LT-EDI-EACL2024: Caste and Migration Hate Speech Detection in Tamil Using Ensembling on Transformers
EACL 2024
Transformers need glasses! Information over-squashing in language tasks
NeurIPS 2024
Transformers on Markov data: Constant depth suffices
NeurIPS 2024
Transformers, parallel computation, and logarithmic depth
ICML 2024
Transformer-specific Interpretability
EACL 2024
Transformers Provably Learn Sparse Token Selection While Fully-Connected Nets Cannot
ICML 2024
Transformers Represent Belief State Geometry in their Residual Stream
NeurIPS 2024
Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models
NeurIPS 2024
Transformer-VQ: Linear-Time Transformers via Vector Quantization
ICLR 2024
Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learner
NeurIPS 2024
TransGOP: Transformer-Based Gaze Object Prediction
AAAI 2024
Transitional Uncertainty with Layered Intermediate Predictions
ICML 2024
Transitivity-Preserving Graph Representation Learning for Bridging Local Connectivity and Role-Based Similarity
AAAI 2024
Translating Subgraphs to Nodes Makes Simple GNNs Strong and Efficient for Subgraph Representation Learning
ICML 2024
Translation Equivariant Transformer Neural Processes
ICML 2024
TransLoc4D: Transformer-based 4D Radar Place Recognition
CVPR 2024
Transmitted and Aggregated Self-Attention for Automatic Speech Recognition
Interspeech 2024
Transolver: A Fast Transformer Solver for PDEs on General Geometries
ICML 2024
Transport of Algebraic Structure to Latent Embeddings
ICML 2024
TransRadar: Adaptive-Directional Transformer for Real-Time Multi-View Radar Semantic Segmentation
WACV 2024
Traveling Waves Encode The Recent Past and Enhance Sequence Learning
ICLR 2024