Efficient Computing

Point Transformer V3: Simpler Faster Stronger CVPR 2024 Poseidon: Efficient Foundation Models for PDEs NeurIPS 2024 Position Engineering: Boosting Large Language Models through Positional Information Manipulation EMNLP 2024 Preparing Lessons for Progressive Training on Language Models AAAI 2024 ProbTS: Benchmarking Point and Distributional Forecasting across Diverse Prediction Horizons NeurIPS 2024 PromptIntern: Saving Inference Costs by Internalizing Recurrent Prompt during Large Language Model Fine-tuning EMNLP 2024 PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference ACL 2024 QTIP: Quantization with Trellises and Incoherence Processing NeurIPS 2024 QT-ViT: Improving Linear Attention in ViT with Quadratic Taylor Expansion NeurIPS 2024 Query-OPT: Optimizing Inference of Large Language Models via Multi-Query Instructions in Meeting Summarization EMNLP 2024 QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models EMNLP 2024 Reducing Transformer Key-Value Cache Size with Cross-Layer Attention NeurIPS 2024 Reg-PTQ: Regression-specialized Post-training Quantization for Fully Quantized Object Detector CVPR 2024 Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling ACL 2024 Resource-Efficient Transformer Pruning for Finetuning of Large Models CVPR 2024 Retaining Key Information under High Compression Ratios: Query-Guided Compressor for LLMs ACL 2024 Rethinking Interactive Image Segmentation with Low Latency High Quality and Diverse Prompts CVPR 2024 Rethinking Memory and Communication Costs for Efficient Data Parallel Training of Large Language Models NeurIPS 2024 Revisiting the Impact of Pursuing Modularity for Code Generation EMNLP 2024 RevMUX: Data Multiplexing with Reversible Adapters for Efficient LLM Batch Inference EMNLP 2024 Salience DETR: Enhancing Detection Transformer with Hierarchical Salience Filtering Refinement CVPR 2024 Scalable Data Ablation Approximations for Language Models through Modular Training and Merging EMNLP 2024 Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention EMNLP 2024 ScaLearn: Simple and Highly Parameter-Efficient Task Transfer by Learning to Scale ACL 2024 Scaling Laws for Data Filtering-- Data Curation cannot be Compute Agnostic CVPR 2024