conftrace_

inference efficiency

248 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) knowledge distillation (3725) inference optimization (219) kv cache (74) efficient computing (781) language model (4599) inference acceleration (244) attention mechanism (4001) neural network (6616)

Papers

TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models CVPR 2024
Revisiting Non-Autoregressive Transformers for Efficient Image Synthesis CVPR 2024
Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning ACL 2024
Mesa-Extrapolation: A Weave Position Encoding Method for Enhanced Extrapolation in LLMs NIPS 2024
Global-Pruner: A Stable and Efficient Pruner for Retraining-Free Pruning of Encoder-Based Language Models CONLL 2024
Dynamic Token-Pass Transformers for Semantic Segmentation WACV 2024
Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Models NAACL 2024
Anchor-based Large Language Models ACL 2024
Layer-Condensed KV Cache for Efficient Inference of Large Language Models ACL 2024
LoRAExit: Empowering Dynamic Modulation of LLMs in Resource-limited Settings using Low-rank Adapters EMNLP 2024
PromptIntern: Saving Inference Costs by Internalizing Recurrent Prompt during Large Language Model Fine-tuning EMNLP 2024
QEFT: Quantization for Efficient Fine-Tuning of LLMs EMNLP 2024
How Does Quantization Affect Multilingual LLMs? EMNLP 2024
PikeLPN: Mitigating Overlooked Inefficiencies of Low-Precision Neural Networks CVPR 2024
Attention-Driven Training-Free Efficiency Enhancement of Diffusion Models CVPR 2024
You Only Cache Once: Decoder-Decoder Architectures for Language Models NIPS 2024
DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion NIPS 2024
Maverick: Efficient and Accurate Coreference Resolution Defying Recent Trends ACL 2024
Hyperparameter-Free Approach for Faster Minimum Bayes Risk Decoding ACL 2024
XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection ACL 2024
BilevelPruning: Unified Dynamic and Static Channel Pruning for Convolutional Neural Networks CVPR 2024
MoE-I2: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition EMNLP 2024
XC-Cache: Cross-Attending to Cached Context for Efficient LLM Inference EMNLP 2024
Temperature-Centric Investigation of Speculative Decoding with Knowledge Distillation EMNLP 2024
Block Transformer: Global-to-Local Language Modeling for Fast Inference NIPS 2024