conftrace_

efficient inference

233 papers

Explore in graph

Also known as

EI

Co-occurring keywords

model compression (3302) efficient computing (781) large language model (13587) knowledge distillation (3725) vision transformer (1106) model quantization (281) convolutional neural network (4226) inference optimization (219) inference efficiency (248) inference acceleration (244)

Papers

Zero-TPrune: Zero-Shot Token Pruning through Leveraging of the Attention Graph in Pre-Trained Transformers CVPR 2024
Clockwork Diffusion: Efficient Generation With Model-Step Distillation CVPR 2024
Pick-or-Mix: Dynamic Channel Sampling for ConvNets CVPR 2024
Localized Debiased Machine Learning: Efficient Inference on Quantile Treatment Effects and Beyond JMLR 2024
FastSR-NeRF: Improving NeRF Efficiency on Consumer Devices With a Simple Super-Resolution Pipeline WACV 2024
ToDo: Token Downsampling for Efficient Generation of High-Resolution Images IJCAI 2024
AFPQ: Asymmetric Floating Point Quantization for LLMs ACL 2024
On Efficient Language and Vision Assistants for Visually-Situated Natural Language Understanding: What Matters in Reading and Reasoning EMNLP 2024
FastAdaSP: Multitask-Adapted Efficient Inference for Large Speech Language Model EMNLP 2024
An Empirical Study on Cross-lingual Vocabulary Adaptation for Efficient Language Model Inference EMNLP 2024
Matryoshka Query Transformer for Large Vision-Language Models NIPS 2024
Don't Look Twice: Faster Video Transformers with Run-Length Tokenization NIPS 2024
Slicing Vision Transformer for Flexible Inference NIPS 2024
SS1: Accelerating Inference with Fast and Expressive Sketch Structured Transform NIPS 2024
SGLang: Efficient Execution of Structured Language Model Programs NIPS 2024
ConsistentEE: A Consistent and Hardness-Guided Early Exiting Method for Accelerating Language Models Inference AAAI 2024
GKT: A Novel Guidance-Based Knowledge Transfer Framework For Efficient Cloud-edge Collaboration LLM Deployment ACL 2024
TensorOpera Router: A Multi-Model Router for Efficient LLM Inference EMNLP 2024
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts NIPS 2024
DiP-GO: A Diffusion Pruner via Few-step Gradient Optimization NIPS 2024
Convolutional Differentiable Logic Gate Networks NIPS 2024
NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention NIPS 2024
Q-VLM: Post-training Quantization for Large Vision-Language Models NIPS 2024
RWKV: Reinventing RNNs for the Transformer Era EMNLP 2023
A Frustratingly Easy Post-Training Quantization Scheme for LLMs EMNLP 2023