inference efficiency

BTR: Binary Token Representations for Efficient Retrieval Augmented Language Models ICLR 2024 Cascade Speculative Drafting for Even Faster LLM Inference NeurIPS 2024 Deciphering RNA Secondary Structure Prediction: A Probabilistic K-Rook Matching Perspective ICML 2024 DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion NeurIPS 2024 Dynamic Token-Pass Transformers for Semantic Segmentation WACV 2024 Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation NeurIPS 2024 Efficient Contrastive Learning for Fast and Accurate Inference on Graphs ICML 2024 Efficient Denoising Diffusion via Probabilistic Masking ICML 2024 Exploiting Activation Sparsity with Dense to Dynamic-k Mixture-of-Experts Conversion NeurIPS 2024 Faster and Lighter LLMs: A Survey on Current Challenges and Way Forward IJCAI 2024 FastFiD: Improve Inference Efficiency of Open Domain Question Answering via Sentence Selection ACL 2024 Global-Pruner: A Stable and Efficient Pruner for Retraining-Free Pruning of Encoder-Based Language Models CoNLL 2024 How Does Quantization Affect Multilingual LLMs? EMNLP 2024 Hyperparameter-Free Approach for Faster Minimum Bayes Risk Decoding ACL 2024 InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory NeurIPS 2024 KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization NeurIPS 2024 Language-Specific Pruning for Efficient Reduction of Large Language Models COLING 2024 Layer-Condensed KV Cache for Efficient Inference of Large Language Models ACL 2024 Learn To be Efficient: Build Structured Sparsity in Large Language Models NeurIPS 2024 LightHGNN: Distilling Hypergraph Neural Networks into MLPs for 100x Faster Inference ICLR 2024 Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning ACL 2024 LoRAExit: Empowering Dynamic Modulation of LLMs in Resource-limited Settings using Low-rank Adapters EMNLP 2024 MagR: Weight Magnitude Reduction for Enhancing Post-Training Quantization NeurIPS 2024 Maverick: Efficient and Accurate Coreference Resolution Defying Recent Trends ACL 2024 Mesa-Extrapolation: A Weave Position Encoding Method for Enhanced Extrapolation in LLMs NeurIPS 2024