conftrace_

inference efficiency

248 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) knowledge distillation (3725) inference optimization (219) kv cache (74) efficient computing (781) language model (4599) inference acceleration (244) attention mechanism (4001) neural network (6616)

Papers

Language-Specific Pruning for Efficient Reduction of Large Language Models COLING 2024
Learn To be Efficient: Build Structured Sparsity in Large Language Models NIPS 2024
InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory NIPS 2024
Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation NIPS 2024
MiniCache: KV Cache Compression in Depth Dimension for Large Language Models NIPS 2024
Accelerating Toeplitz Neural Network with Constant-time Inference Complexity EMNLP 2023
Cost-effective Artificial Neural Networks IJCAI 2023
Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time ICML 2023
Predictive Exit: Prediction of Fine-Grained Early Exits for Computation- and Energy-Efficient Inference AAAI 2023
Conditional Adapters: Parameter-efficient Transfer Learning with Fast Inference NIPS 2023
H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models NIPS 2023
Speculative Decoding with Big Little Decoder NIPS 2023
Dynamic Context Pruning for Efficient and Interpretable Autoregressive Transformers NIPS 2023
Cheaply Estimating Inference Efficiency Metrics for Autoregressive Transformer Models NIPS 2023
HadSkip: Homotopic and Adaptive Layer Skipping of Pre-trained Language Models for Efficient Inference EMNLP 2023
Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions NIPS 2023
Not All Neighbors Matter: Point Distribution-Aware Pruning for 3D Point Cloud AAAI 2023
Open-ended Long Text Generation via Masked Language Modeling ACL 2023
GWQ: Group-Wise Quantization Framework for Neural Networks ACML 2023
An Exploratory Study on Model Compression for Text-to-SQL ACL 2023
Are Straight-Through Gradients and Soft-Thresholding All You Need for Sparse Training? WACV 2023
DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language Models ACL 2023
AutoGO: Automated Computation Graph Optimization for Neural Network Evolution NIPS 2023
A Metric-Driven Approach to Conformer Layer Pruning for Efficient ASR Inference INTERSPEECH 2023
The Framework Tax: Disparities Between Inference Efficiency in NLP Research and Deployment EMNLP 2023