inference latency

Ultra-Sparse Memory Network ICLR 2025 zFLoRA: Zero-Latency Fused Low-Rank Adapters EMNLP 2025 Adaptive Depth Networks with Skippable Sub-Paths NeurIPS 2024 AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising NeurIPS 2024 CHAI: Clustered Head Attention for Efficient LLM Inference ICML 2024 CQIL: Inference Latency Optimization with Concurrent Computation of Quasi-Independent Layers ACL 2024 Distilling Autoregressive Models to Obtain High-Performance Non-autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed AAAI 2024 EC-SNN: Splitting Deep Spiking Neural Networks for Edge Devices IJCAI 2024 Enhancing Training of Spiking Neural Network with Stochastic Latency AAAI 2024 FanLoRA: Fantastic LoRAs and Where to Find Them in Large Language Model Fine-tuning EMNLP 2024 Fast Decision Boundary based Out-of-Distribution Detector ICML 2024 HiRT: Enhancing Robotic Control with Hierarchical Robot Transformers CoRL 2024 HuBERT-EE: Early Exiting HuBERT for Efficient Speech Recognition Interspeech 2024 Kraken: Inherently Parallel Transformers For Efficient Multi-Device Inference NeurIPS 2024 Learning to Compress Prompt in Natural Language Formats NAACL 2024 QUEST: Query-Aware Sparsity for Efficient Long-Context LLM Inference ICML 2024 Sparse High Rank Adapters NeurIPS 2024 Alternating Updates for Efficient Transformers NeurIPS 2023 A Multi-dimensional Evaluation of Tokenizer-free Multilingual Pretrained Models EACL 2023 A Survey for Efficient Open Domain Question Answering ACL 2023 Efficient Edge Inference by Selective Query ICLR 2023 Efficient Latency-Aware CNN Depth Compression via Two-Stage Dynamic Programming ICML 2023 Gradient-Free Structured Pruning with Unlabeled Data ICML 2023 Harmonic-NAS: Hardware-Aware Multimodal Neural Architecture Search on Resource-constrained Devices ACML 2023 MobileOne: An Improved One Millisecond Mobile Backbone CVPR 2023