transformer architecture

Handformer2T: A Lightweight Regression-Based Model for Interacting Hands Pose Estimation From a Single RGB Image WACV 2024 Harder Task Needs More Experts: Dynamic Routing in MoE Models ACL 2024 HDformer: A Higher-Dimensional Transformer for Detecting Diabetes Utilizing Long-Range Vascular Signals AAAI 2024 Heterogeneous Graph Transformer with Poly-Tokenization IJCAI 2024 Highly Granular Dialect Normalization and Phonological Dialect Translation for Limburgish NAACL 2024 HOIST-Former: Hand-held Objects Identification Segmentation and Tracking in the Wild CVPR 2024 HomoFormer: Homogenized Transformer for Image Shadow Removal CVPR 2024 How Are Metaphors Processed by Language Models? The Case of Analogies CoNLL 2024 How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers NeurIPS 2024 How Do Transformers Learn In-Context Beyond Simple Functions? A Case Study on Learning with Representations ICLR 2024 How Much Context Does My Attention-Based ASR System Need? Interspeech 2024 Humanoid Locomotion as Next Token Prediction NeurIPS 2024 HW-TSC’s Submissions To the IWSLT2024 Low-resource Speech Translation Tasks ACL 2024 Hybrid Sharing for Multi-Label Image Classification ICLR 2024 Improving Spectral Snapshot Reconstruction with Spectral-Spatial Rectification CVPR 2024 Improving Transformers with Dynamically Composable Multi-Head Attention ICML 2024 Inducing Point Operator Transformer: A Flexible and Scalable Architecture for Solving PDEs AAAI 2024 Inducing Systematicity in Transformers by Attending to Structurally Quantized Embeddings ACL 2024 Industry vs Academia: Running a Course on Transformers in Two Setups ACL 2024 Infinite Limits of Multi-head Transformer Dynamics NeurIPS 2024 InterpBench: Semi-Synthetic Transformers for Evaluating Mechanistic Interpretability Techniques NeurIPS 2024 Interpreting Context Look-ups in Transformers: Investigating Attention-MLP Interactions EMNLP 2024 IR-FRestormer: Iterative Refinement With Fourier-Based Restormer for Accelerated MRI Reconstruction WACV 2024 iTransformer: Inverted Transformers Are Effective for Time Series Forecasting ICLR 2024 iVideoGPT: Interactive VideoGPTs are Scalable World Models NeurIPS 2024