efficient inference

Rethinking Imbalance in Image Super-Resolution for Efficient Inference NeurIPS 2024 SGLang: Efficient Execution of Structured Language Model Programs NeurIPS 2024 Slicing Vision Transformer for Flexible Inference NeurIPS 2024 SS1: Accelerating Inference with Fast and Expressive Sketch Structured Transform NeurIPS 2024 SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention NeurIPS 2024 TensorOpera Router: A Multi-Model Router for Efficient LLM Inference EMNLP 2024 ToDo: Token Downsampling for Efficient Generation of High-Resolution Images IJCAI 2024 Toward Efficient Inference for Mixture of Experts NeurIPS 2024 Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learner NeurIPS 2024 TroL: Traversal of Layers for Large Language and Vision Models EMNLP 2024 Visual Anchors Are Strong Information Aggregators For Multimodal Large Language Model NeurIPS 2024 Zero-TPrune: Zero-Shot Token Pruning through Leveraging of the Attention Graph in Pre-Trained Transformers CVPR 2024 Adaptive Sparse Convolutional Networks With Global Context Enhancement for Faster Object Detection on Drone Images CVPR 2023 A Dynamic Multi-Scale Voxel Flow Network for Video Prediction CVPR 2023 A Frustratingly Easy Post-Training Quantization Scheme for LLMs EMNLP 2023 A Survey on Model Compression and Acceleration for Pretrained Language Models AAAI 2023 Auto-CARD: Efficient and Robust Codec Avatar Driving for Real-Time Mobile Telepresence CVPR 2023 BiViT: Extremely Compressed Binary Vision Transformers ICCV 2023 Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention at Vision Transformer Inference CVPR 2023 CocaCLIP: Exploring Distillation of Fully-Connected Knowledge Interaction Graph for Lightweight Text-Image Retrieval ACL 2023 DBQ-SSD: Dynamic Ball Query for Efficient 3D Object Detection ICLR 2023 Distilling Efficient Language-Specific Models for Cross-Lingual Transfer ACL 2023 Efficient Sequence Transduction by Jointly Predicting Tokens and Durations ICML 2023 EfficientViT: Memory Efficient Vision Transformer With Cascaded Group Attention CVPR 2023 EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning ACL 2023