model inference

DroidSpeak: KV Cache Sharing Across Fine-tuned Model Variants NSDI 2026 Elevating AI on the Edge: A Demonstration of MIMaaS (Machine Intelligence with Microcontroller-as-a-Service) AAAI 2026 SMIDT: High-Performance Inference Framework for MoE Models with Dynamic Top-K Routing AAAI 2026 SpecDiff: Accelerating Diffusion Model Inference with Self-Speculation AAAI 2026 BigMac: A Communication-Efficient Mixture-of-Experts Model Structure for Fast Training and Inference AAAI 2025 Dovetail: A CPU/GPU Heterogeneous Speculative Decoding for LLM inference EMNLP 2025 Energy Considerations of Large Language Model Inference and Efficiency Optimizations ACL 2025 FastPoint: Accelerating 3D Point Cloud Model Inference via Sample Point Distance Prediction ICCV 2025 Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models ICLR 2025 Hardware-Aware Parallel Prompt Decoding for Memory-Efficient Acceleration of LLM Inference EMNLP 2025 On Probabilistic Truncation in Privacy-preserving Machine Learning AAAI 2025 Optimized Multi-Token Joint Decoding With Auxiliary Model for LLM Inference ICLR 2025 RazorAttention: Efficient KV Cache Compression Through Retrieval Heads ICLR 2025 SqueezeAttention: 2D Management of KV-Cache in LLM Inference via Layer-wise Optimal Budget ICLR 2025 WaferLLM: Large Language Model Inference at Wafer Scale OSDI 2025 CHESS: Optimizing LLM Inference via Channel-Wise Thresholding and Selective Sparsification EMNLP 2024 Learning Broadcast Protocols AAAI 2024 NeuralFuse: Learning to Recover the Accuracy of Access-Limited Neural Network Inference in Low-Voltage Regimes NeurIPS 2024 Normalized Narrow Jump To Conclusions: Normalized Narrow Shortcuts for Parameter Efficient Early Exit Transformer Prediction EMNLP 2024 ServerlessLLM: Low-Latency Serverless Inference for Large Language Models OSDI 2024 SimSCOOD: Systematic Analysis of Out-of-Distribution Generalization in Fine-tuned Source Code Models NAACL 2024 SpecExec: Massively Parallel Speculative Decoding For Interactive LLM Inference on Consumer Devices NeurIPS 2024 Whispers that Shake Foundations: Analyzing and Mitigating False Premise Hallucinations in Large Language Models EMNLP 2024 Fast and Accurate Binary Neural Networks Based on Depth-Width Reshaping AAAI 2023 Improving the Robustness of Summarization Models by Detecting and Removing Input Noise EMNLP 2023