Transformers

LongHeads: Multi-Head Attention is Secretly a Long Context Processor EMNLP 2024 Long Sequence Modeling with Attention Tensorization: From Sequence to Tensor Learning EMNLP 2024 Long Unit Word Tokenization and Bunsetsu Segmentation of Historical Japanese ACL 2024 LongVQ: Long Sequence Modeling with Vector Quantization on Structured Memory IJCAI 2024 LookHere: Vision Transformers with Directed Attention Generalize and Extrapolate NeurIPS 2024 Looking 3D: Anomaly Detection with 2D-3D Alignment CVPR 2024 LookupViT: Compressing visual information to a limited number of tokens ECCV 2024 Looped Transformers are Better at Learning Learning Algorithms ICLR 2024 LoRA+: Efficient Low Rank Adaptation of Large Models ICML 2024 LoRAExit: Empowering Dynamic Modulation of LLMs in Resource-limited Settings using Low-rank Adapters EMNLP 2024 LoRA-MER: Low-Rank Adaptation of Pre-Trained Speech Models for Multimodal Emotion Recognition Using Mutual Information Interspeech 2024 LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin ACL 2024 LoRASC: Expressive and Generalizable Low-rank Adaptation for Large Models via Slow Cascaded Learning EMNLP 2024 Loss Shaping Constraints for Long-Term Time Series Forecasting ICML 2024 Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach CVPR 2024 LPZero: Language Model Zero-cost Proxy Search from Zero EMNLP 2024 LQMFormer: Language-aware Query Mask Transformer for Referring Image Segmentation CVPR 2024 LRM: Large Reconstruction Model for Single Image to 3D ICLR 2024 LRM-Zero: Training Large Reconstruction Models with Synthesized Data NeurIPS 2024 LSH-MoE: Communication-efficient MoE Training via Locality-Sensitive Hashing NeurIPS 2024 Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Models NeurIPS 2024 Lumina-Next : Making Lumina-T2X Stronger and Faster with Next-DiT NeurIPS 2024 LUM-ViT: Learnable Under-sampling Mask Vision Transformer for Bandwidth Limited Optical Signal Acquisition ICLR 2024 LungAdapter: Efficient Adapting Audio Spectrogram Transformer for Lung Sound Classification Interspeech 2024 LUT-GEMM: Quantized Matrix Multiplication based on LUTs for Efficient Inference in Large-Scale Generative Language Models ICLR 2024