transformer architecture

1555 papers

Explore in graph

Also known as

TTE STTR TGT DIT ENT BERT DETR ROBERTA TA

Co-occurring keywords

attention mechanism (3975) neural machine translation (2310) transformer model (1988) representation learning (6174) language model (4573) neural network (6616) self-attention mechanism (350) multimodal learning (4622) machine translation (2472) large language model (12755)

Papers

Inducing Systematicity in Transformers by Attending to Structurally Quantized Embeddings ACL 2024

CAR-Transformer: Cross-Attention Reinforcement Transformer for Cross-Lingual Summarization AAAI 2024

On the In-context Generation of Language Models EMNLP 2024

UPS: Unified Projection Sharing for Lightweight Single-Image Super-resolution and Beyond NIPS 2024

Target Focused Shallow Transformer Framework for Efficient Visual Tracking AAAI 2024

Can Transformers Learn n-gram Language Models? EMNLP 2024

SparseFlow: Accelerating Transformers by Sparsifying Information Flows ACL 2024

Aligning Geometric Spatial Layout in Cross-View Geo-Localization via Feature Recombination AAAI 2024

How Are Metaphors Processed by Language Models? The Case of Analogies CONLL 2024

STViT: Improving Self-Supervised Multi-Camera Depth Estimation with Spatial-Temporal Context and Adversarial Geometry Regularization (Student Abstract) AAAI 2024

CRA-PCN: Point Cloud Completion with Intra- and Inter-level Cross-Resolution Transformers AAAI 2024

Unraveling the Gradient Descent Dynamics of Transformers NIPS 2024

ShareBERT: Embeddings Are Capable of Learning Hidden Layers AAAI 2024

InterpBench: Semi-Synthetic Transformers for Evaluating Mechanistic Interpretability Techniques NIPS 2024

WaveFormer: Wavelet Transformer for Noise-Robust Video Inpainting AAAI 2024

Highly Granular Dialect Normalization and Phonological Dialect Translation for Limburgish NAACL 2024

Preparing Lessons for Progressive Training on Language Models AAAI 2024

LLM-based MT Data Creation: Dialectal to MSA Translation Shared Task COLING 2024

Equity-Transformer: Solving NP-Hard Min-Max Routing Problems as Sequential Generation with Equity Context AAAI 2024

Topic-Controllable Summarization: Topic-Aware Evaluation and Transformer Methods COLING 2024

Multi-Modal Discussion Transformer: Integrating Text, Images and Graph Transformers to Detect Hate Speech on Social Media AAAI 2024

Federated Transformer: Multi-Party Vertical Federated Learning on Practical Fuzzily Linked Data NIPS 2024

BabyHGRN: Exploring RNNs for Sample-Efficient Language Modeling CONLL 2024

Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models ACL 2024

SA²VP: Spatially Aligned-and-Adapted Visual Prompt AAAI 2024