efficient inference

Clockwork Diffusion: Efficient Generation With Model-Step Distillation CVPR 2024 ConsistentEE: A Consistent and Hardness-Guided Early Exiting Method for Accelerating Language Models Inference AAAI 2024 Convolutional Differentiable Logic Gate Networks NeurIPS 2024 DAISY: Data Adaptive Self-Supervised Early Exit for Speech Representation Models Interspeech 2024 DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution NeurIPS 2024 DiP-GO: A Diffusion Pruner via Few-step Gradient Optimization NeurIPS 2024 Don't Look Twice: Faster Video Transformers with Run-Length Tokenization NeurIPS 2024 Efficient Audio Captioning with Encoder-Level Knowledge Distillation Interspeech 2024 FastAdaSP: Multitask-Adapted Efficient Inference for Large Speech Language Model EMNLP 2024 FastSR-NeRF: Improving NeRF Efficiency on Consumer Devices With a Simple Super-Resolution Pipeline WACV 2024 Fast Text-to-3D-Aware Face Generation and Manipulation via Direct Cross-modal Mapping and Geometric Regularization ICML 2024 Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models NeurIPS 2024 GKT: A Novel Guidance-Based Knowledge Transfer Framework For Efficient Cloud-edge Collaboration LLM Deployment ACL 2024 HyperAttention: Long-context Attention in Near-Linear Time ICLR 2024 LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding ACL 2024 LLM in a flash: Efficient Large Language Model Inference with Limited Memory ACL 2024 Localized Debiased Machine Learning: Efficient Inference on Quantile Treatment Effects and Beyond JMLR 2024 Matryoshka Query Transformer for Large Vision-Language Models NeurIPS 2024 MaxQ: Multi-Axis Query for N:M Sparsity Network CVPR 2024 Mixture of Nested Experts: Adaptive Processing of Visual Tokens NeurIPS 2024 NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention NeurIPS 2024 On Efficient Language and Vision Assistants for Visually-Situated Natural Language Understanding: What Matters in Reading and Reasoning EMNLP 2024 On the Impact of Calibration Data in Post-training Quantization and Pruning ACL 2024 Pick-or-Mix: Dynamic Channel Sampling for ConvNets CVPR 2024 Q-VLM: Post-training Quantization for Large Vision-Language Models NeurIPS 2024