Efficient Computing

Chunk, Align, Select: A Simple Long-sequence Processing Method for Transformers ACL 2024 ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition ACL 2024 Colour Passing Revisited: Lifted Model Construction with Commutative Factors AAAI 2024 CoMERA: Computing- and Memory-Efficient Training via Rank-Adaptive Tensor Optimization NeurIPS 2024 Computer Vision on the Edge: Individual Cattle Identification in Real-Time With ReadMyCow System WACV 2024 Context-Aware Assistant Selection for Improved Inference Acceleration with Large Language Models EMNLP 2024 Continual Learning on a Diet: Learning from Sparsely Labeled Streams Under Constrained Computation ICLR 2024 Cost-Performance Optimization for Processing Low-Resource Language Tasks Using Commercial LLMs EMNLP 2024 CQIL: Inference Latency Optimization with Concurrent Computation of Quasi-Independent Layers ACL 2024 DASH: Warm-Starting Neural Network Training in Stationary Settings without Loss of Plasticity NeurIPS 2024 Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLMs ICLR 2024 EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees EMNLP 2024 Efficient Large Multi-modal Models via Visual Context Compression NeurIPS 2024 Efficient Lifelong Model Evaluation in an Era of Rapid Progress NeurIPS 2024 Efficient LLM Scheduling by Learning to Rank NeurIPS 2024 End-to-End Temporal Action Detection with 1B Parameters Across 1000 Frames CVPR 2024 EnOF-SNN: Training Accurate Spiking Neural Networks via Enhancing the Output Feature NeurIPS 2024 Environmental Impact Measurement in the MentalRiskES Evaluation Campaign COLING 2024 ETAS: Zero-Shot Transformer Architecture Search via Network Trainability and Expressivity ACL 2024 Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation AAAI 2024 Exploring Token Pruning in Vision State Space Models NeurIPS 2024 Extending Power of Nature from Binary to Real-Valued Graph Learning in Real World ICLR 2024 Faster and Lighter LLMs: A Survey on Current Challenges and Way Forward IJCAI 2024 FasterDiT: Towards Faster Diffusion Transformers Training without Architecture Modification NeurIPS 2024 Faster Neighborhood Attention: Reducing the O(n^2) Cost of Self Attention at the Threadblock Level NeurIPS 2024