Transformers

SAMformer: Unlocking the Potential of Transformers in Time Series Forecasting with Sharpness-Aware Minimization and Channel-Wise Attention ICML 2024 SAM-Guided Masked Token Prediction for 3D Scene Understanding NeurIPS 2024 Samsung R&D Institute Philippines @ WMT 2024 Indic MT Task EMNLP 2024 Samsung R&D Institute Philippines @ WMT 2024 Low-resource Languages of Spain Shared Task EMNLP 2024 Sandalphon@DravidianLangTech-EACL2024: Hate and Offensive Language Detection in Telugu Code-mixed Text using Transliteration-Augmentation EACL 2024 SAND: Smooth imputation of sparse and noisy functional data with Transformer networks NeurIPS 2024 SARCAT: Generative Span-Act Guided Response Generation using Copy-enhanced Target Augmentation EMNLP 2024 Satformer: Accurate and Robust Traffic Data Estimation for Satellite Networks NeurIPS 2024 SBCFormer: Lightweight Network Capable of Full-Size ImageNet Classification at 1 FPS on Single Board Computers WACV 2024 Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention EMNLP 2024 Scalable High-Resolution Pixel-Space Image Synthesis with Hourglass Diffusion Transformers ICML 2024 SCaLAR at SemEval-2024 Task 8: Unmasking the machine : Exploring the power of RoBERTa Ensemble for Detecting Machine Generated Text SemEval 2024 ScaleKD: Strong Vision Transformers Could Be Excellent Teachers NeurIPS 2024 Scaling Beyond the GPU Memory Limit for Large Mixture-of-Experts Model Training ICML 2024 Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviation CoRL 2024 Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models EMNLP 2024 Scaling Manipulation Learning with Visual Kinematic Chain Prediction CoRL 2024 Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers NeurIPS 2024 Scaling Rectified Flow Transformers for High-Resolution Image Synthesis ICML 2024 Scaling Sign Language Translation NeurIPS 2024 Scaling transformer neural networks for skillful and reliable medium-range weather forecasting NeurIPS 2024 Scaling White-Box Transformers for Vision NeurIPS 2024 ScanFormer: Referring Expression Comprehension by Iteratively Scanning CVPR 2024 Scene Flow Prior Based Point Cloud Completion with Masked Transformer (Student Abstract) AAAI 2024 Scene-Graph ViT: End-to-End Open-Vocabulary Visual Relationship Detection ECCV 2024