Efficient Computing

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression ACL 2024 LLM Maybe LongLM: SelfExtend LLM Context Window Without Tuning ICML 2024 LLoCO: Learning Long Contexts Offline EMNLP 2024 Llumnix: Dynamic Scheduling for Large Language Model Serving OSDI 2024 LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Models NAACL 2024 Load is not what you should balance: Introducing Prequal NSDI 2024 Locality-Sensitive Hashing-Based Efficient Point Transformer with Applications in High-Energy Physics ICML 2024 Localizing Task Information for Improved Model Merging and Compression ICML 2024 Locally Biased Transformers Better Align with Human Reading Times ACL 2024 Local Superior Soups: A Catalyst for Model Merging in Cross-Silo Federated Learning NeurIPS 2024 LoCoCo: Dropping In Convolutions for Long Context Compression ICML 2024 Loki: Low-rank Keys for Efficient Sparse Attention NeurIPS 2024 LoNAS: Elastic Low-Rank Adapters for Efficient Large Language Models COLING 2024 Long Context is Not Long at All: A Prospector of Long-Dependency Data for Large Language Models ACL 2024 Long-Context Language Modeling with Parallel Context Encoding ACL 2024 LongHeads: Multi-Head Attention is Secretly a Long Context Processor EMNLP 2024 LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression ACL 2024 LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models ICLR 2024 Long-Short-Range Message-Passing: A Physics-Informed Framework to Capture Non-Local Interaction for Scalable Molecular Dynamics Simulation ICLR 2024 Lookbehind-SAM: k steps back, 1 step forward ICML 2024 LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference EMNLP 2024 Look-Up Table Compression for Efficient Image Restoration CVPR 2024 LookupViT: Compressing visual information to a limited number of tokens ECCV 2024 LoQT: Low-Rank Adapters for Quantized Pretraining NeurIPS 2024 LoRA+: Efficient Low Rank Adaptation of Large Models ICML 2024