transformer inference

EdgeFormer: Latency-Aware Collaborative Multi-Head Attention of Transformer Inference in Edge Networks ACL 2026 PCFormer: Accelerating Privacy-preserving Transformer Inference by Partition and Combination AAAI 2026 SecMoE: Communication-Efficient Secure MoE Inference via Select-Then-Compute AAAI 2026 Self-Indexing KVCache: Predicting Sparse Attention from Compressed Keys AAAI 2026 A-VL: Adaptive Attention for Large Vision-Language Models AAAI 2025 CENTAUR: Bridging the Impossible Trinity of Privacy, Efficiency, and Performance in Privacy-Preserving Transformer Inference ACL 2025 Accelerating Transformer Inference for Translation via Parallel Decoding ACL 2023 Fast Inference from Transformers via Speculative Decoding ICML 2023 MPCFORMER: FAST, PERFORMANT AND PRIVATE TRANSFORMER INFERENCE WITH MPC ICLR 2023 Accelerating Inference for Pretrained Language Models by Unified Multi-Perspective Early Exiting COLING 2022 Easy and Efficient Transformer: Scalable Inference Solution For Large NLP Model NAACL 2022 THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption ACL 2022 Zero-Shot Dynamic Quantization for Transformer Inference EMNLP 2022 FastSeq: Make Sequence Generation Faster ACL 2021