transformer architecture

1555 papers

Explore in graph

Also known as

TTE STTR TGT DIT ENT BERT DETR ROBERTA TA

Co-occurring keywords

attention mechanism (3975) neural machine translation (2310) transformer model (1988) representation learning (6174) language model (4573) neural network (6616) self-attention mechanism (350) multimodal learning (4622) machine translation (2472) large language model (12755)

Papers

On the Expressivity Role of LayerNorm in Transformers’ Attention ACL 2023

GNOT: A General Neural Operator Transformer for Operator Learning ICML 2023

Latent Positional Information is in the Self-Attention Variance of Transformer Language Models Without Positional Embeddings ACL 2023

Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstruction ICCV 2023

MMTN: Multi-Modal Memory Transformer Network for Image-Report Consistent Medical Report Generation AAAI 2023

Dynamic Mesh Recovery from Partial Point Cloud Sequence ICCV 2023

Humans in 4D: Reconstructing and Tracking Humans with Transformers ICCV 2023

TransVCL: Attention-Enhanced Video Copy Localization Network with Flexible Supervision AAAI 2023

Composite Relationship Fields With Transformers for Scene Graph Generation WACV 2023

Attention-Conditioned Augmentations for Self-Supervised Anomaly Detection and Localization AAAI 2023

Name Your Colour For the Task: Artificially Discover Colour Naming via Colour Quantisation Transformer ICCV 2023

Ultra-High-Definition Low-Light Image Enhancement: A Benchmark and Transformer-Based Method AAAI 2023

Scaling Laws for Discriminative Speech Recognition Rescoring Models INTERSPEECH 2023

GPTR: Gestalt-Perception Transformer for Diagram Object Detection AAAI 2023

The Naughtyformer: A Transformer Understands and Moderates Adult Humor (Student Abstract) AAAI 2023

Viettel-AI at SemEval-2023 Task 6: Legal Document Understanding with Longformer for Court Judgment Prediction with Explanation SEMEVAL 2023

PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Prediction AAAI 2023

AirFormer: Predicting Nationwide Air Quality in China with Transformers AAAI 2023

Exploring Energy-based Language Models with Different Architectures and Training Methods for Speech Recognition INTERSPEECH 2023

CASA-ASR: Context-Aware Speaker-Attributed ASR INTERSPEECH 2023

Learning Cross-Modal Affinity for Referring Video Object Segmentation Targeting Limited Samples ICCV 2023

RenewNAT: Renewing Potential Translation for Non-autoregressive Transformer AAAI 2023

Uncertainty-aware State Space Transformer for Egocentric 3D Hand Trajectory Forecasting ICCV 2023

Adaptive Template Transformer for Mitochondria Segmentation in Electron Microscopy Images ICCV 2023

DLGSANet: Lightweight Dynamic Local and Global Self-Attention Networks for Image Super-Resolution ICCV 2023