conftrace_

inference efficiency

248 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) knowledge distillation (3725) inference optimization (219) kv cache (74) efficient computing (781) language model (4599) inference acceleration (244) attention mechanism (4001) neural network (6616)

Papers

Towards Fully Quantized Neural Networks For Speech Enhancement INTERSPEECH 2023
REx: Data-Free Residual Quantization Error Expansion NIPS 2023
Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Time NIPS 2023
Boosted Dynamic Neural Networks AAAI 2023
You Need Multiple Exiting: Dynamic Early Exiting for Accelerating Unified Vision Language Model CVPR 2023
Boosting Inference Efficiency: Unleashing the Power of Parameter-Shared Pre-trained Language Models EMNLP 2023
TCRA-LLM: Token Compression Retrieval Augmented Large Language Model for Inference Cost Reduction EMNLP 2023
Attend, Select and Eliminate: Accelerating Multi-turn Response Selection with Dual-attention-based Content Elimination ACL 2023
Compressing Context to Enhance Inference Efficiency of Large Language Models EMNLP 2023
Gatekeeper to save COGS and improve efficiency of Text Prediction EMNLP 2023
AMOM: Adaptive Masking over Masking for Conditional Masked Language Model AAAI 2023
Dynamic Transformers Provide a False Sense of Efficiency ACL 2023
SlowBERT: Slow-down Attacks on Input-adaptive Multi-exit BERT ACL 2023
Dynamic and Efficient Inference for Text Generation via BERT Family ACL 2023
INK: Injecting kNN Knowledge in Nearest Neighbor Machine Translation ACL 2023
Exploring the Relative Value of Collaborative Optimisation Pathways (Student Abstract) AAAI 2023
Towards Inference Efficient Deep Ensemble Learning AAAI 2023
Linearizing Transformer with Key-Value Memory EMNLP 2022
ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference ACL 2022
ELMER: A Non-Autoregressive Pre-trained Language Model for Efficient and Effective Text Generation EMNLP 2022
FP8 Quantization: The Power of the Exponent NIPS 2022
Non-autoregressive Translation with Layer-Wise Prediction and Deep Supervision AAAI 2022
Latency-aware Spatial-wise Dynamic Networks NIPS 2022
A-ViT: Adaptive Tokens for Efficient Vision Transformer CVPR 2022
MoEfication: Transformer Feed-forward Layers are Mixtures of Experts ACL 2022