conftrace_

efficient inference

233 papers

Explore in graph

Also known as

EI

Co-occurring keywords

model compression (3302) efficient computing (781) large language model (13587) knowledge distillation (3725) vision transformer (1106) model quantization (281) convolutional neural network (4226) inference optimization (219) inference efficiency (248) inference acceleration (244)

Papers

500xCompressor: Generalized Prompt Compression for Large Language Models ACL 2025
Ladder-Residual: Parallelism-Aware Architecture for Accelerating Large Model Inference with Communication Overlapping ICML 2025
p-MoD: Building Mixture-of-Depths MLLMs via Progressive Ratio Decay ICCV 2025
Harnessing Input-Adaptive Inference for Efficient VLN ICCV 2025
DIVE into MoE: Diversity-Enhanced Reconstruction of Large Language Models from Dense into Mixture-of-Experts ACL 2025
TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection EMNLP 2025
QUITO-X: A New Perspective on Context Compression from the Information Bottleneck Theory EMNLP 2025
Bitnet.cpp: Efficient Edge Inference for Ternary LLMs ACL 2025
ReMamba: Equip Mamba with Effective Long-Sequence Modeling EMNLP 2025
HMT: Hierarchical Memory Transformer for Efficient Long Context Language Processing NAACL 2025
DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution NIPS 2024
LLM in a flash: Efficient Large Language Model Inference with Limited Memory ACL 2024
Mixture of Nested Experts: Adaptive Processing of Visual Tokens NIPS 2024
ToDo: Token Downsampling for Efficient Generation of High-Resolution Images IJCAI 2024
TensorOpera Router: A Multi-Model Router for Efficient LLM Inference EMNLP 2024
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts NIPS 2024
DAISY: Data Adaptive Self-Supervised Early Exit for Speech Representation Models INTERSPEECH 2024
Efficient Audio Captioning with Encoder-Level Knowledge Distillation INTERSPEECH 2024
FastSR-NeRF: Improving NeRF Efficiency on Consumer Devices With a Simple Super-Resolution Pipeline WACV 2024
DiP-GO: A Diffusion Pruner via Few-step Gradient Optimization NIPS 2024
Localized Debiased Machine Learning: Efficient Inference on Quantile Treatment Effects and Beyond JMLR 2024
MaxQ: Multi-Axis Query for N:M Sparsity Network CVPR 2024
SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention NIPS 2024
GKT: A Novel Guidance-Based Knowledge Transfer Framework For Efficient Cloud-edge Collaboration LLM Deployment ACL 2024
Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models NIPS 2024