Efficient Computing

Low-Rank Approximation for Sparse Attention in Multi-Modal LLMs CVPR 2024 LSH-MoE: Communication-efficient MoE Training via Locality-Sensitive Hashing NeurIPS 2024 LSK3DNet: Towards Effective and Efficient 3D Perception with Large Sparse Kernels CVPR 2024 L-TTA: Lightweight Test-Time Adaptation Using a Versatile Stem Layer NeurIPS 2024 Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training EMNLP 2024 MapLE: Matching Molecular Analogues Promptly with Low Computational Resources by Multi-Metrics Evaluation (Student Abstract) AAAI 2024 MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualization ACL 2024 MediSwift: Efficient Sparse Pre-trained Biomedical Language Models ACL 2024 Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length NeurIPS 2024 Memorize Step by Step: Efficient Long-Context Prefilling with Incremental Memory and Decremental Chunk EMNLP 2024 MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention NeurIPS 2024 Mitigating Hallucinations in Large Vision-Language Models (LVLMs) via Language-Contrastive Decoding (LCD) ACL 2024 Mixture-of-Modules: Reinventing Transformers as Dynamic Assemblies of Modules EMNLP 2024 Mixture of Nested Experts: Adaptive Processing of Visual Tokens NeurIPS 2024 Mixture-of-Supernets: Improving Weight-Sharing Supernet Training with Architecture-Routed Mixture-of-Experts ACL 2024 MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training CVPR 2024 MobileInst: Video Instance Segmentation on the Mobile AAAI 2024 MobileQuant: Mobile-friendly Quantization for On-device Language Models EMNLP 2024 MobileSpeech: A Fast and High-Fidelity Framework for Mobile Zero-Shot Text-to-Speech ACL 2024 Model Adaptation for Time Constrained Embodied Control CVPR 2024 MOSEL: Inference Serving Using Dynamic Modality Selection EMNLP 2024 MSPE: Multi-Scale Patch Embedding Prompts Vision Transformers to Any Resolution NeurIPS 2024 Multi-criteria Token Fusion with One-step-ahead Attention for Efficient Vision Transformers CVPR 2024 MuLTI: Efficient Video-and-Language Understanding with Text-Guided MultiWay-Sampler and Multiple Choice Modeling AAAI 2024 MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Captures CVPR 2024