Efficient Computing

SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient ICML 2023 SwiftFormer: Efficient Additive Attention for Transformer-based Real-time Mobile Vision Applications ICCV 2023 SyncTREE: Fast Timing Analysis for Integrated Circuit Design through a Physics-informed Tree-based Graph Neural Network NeurIPS 2023 System-Status-Aware Adaptive Network for Online Streaming Video Understanding CVPR 2023 Task-Agnostic Structured Pruning of Speech Representation Models Interspeech 2023 Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering ACL 2023 Task Difficulty Aware Parameter Allocation & Regularization for Lifelong Learning CVPR 2023 TaskPrompter: Spatial-Channel Multi-Task Prompting for Dense Scene Understanding ICLR 2023 TCFLE-8: a Corpus of Learner Written Productions for French as a Foreign Language and its Application to Automated Essay Scoring EMNLP 2023 TCRA-LLM: Token Compression Retrieval Augmented Large Language Model for Inference Cost Reduction EMNLP 2023 Teacher Assistant-Based Knowledge Distillation Extracting Multi-level Features on Single Channel Sleep EEG IJCAI 2023 Ted: Tree delineation with reduced dimensions using entropy and deep learning ACML 2023 Temporal Dynamic Quantization for Diffusion Models NeurIPS 2023 Tensor decomposition for minimization of E2E SLU model toward on-device processing Interspeech 2023 TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding EMNLP 2023 Texts as Images in Prompt Tuning for Multi-Label Image Recognition CVPR 2023 The case for 4-bit precision: k-bit Inference Scaling Laws ICML 2023 The economic trade-offs of large language models: A case study ACL 2023 The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Matter NeurIPS 2023 The Framework Tax: Disparities Between Inference Efficiency in NLP Research and Deployment EMNLP 2023 The Grand Illusion: The Myth of Software Portability and Implications for ML Progress. NeurIPS 2023 The NLP Task Effectiveness of Long-Range Transformers EACL 2023 Three Guidelines You Should Know for Universally Slimmable Self-Supervised Learning CVPR 2023 Tiny Updater: Towards Efficient Neural Network-Driven Software Updating ICCV 2023 TIPS: Topologically Important Path Sampling for Anytime Neural Networks ICML 2023