conftrace_

inference latency

72 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) efficient computing (781) neural network (6616) knowledge distillation (3725) model efficiency (206) inference efficiency (248) spiking neural network (331) neural network optimization (1293) neural machine translation (2310)

Papers

HERMES: temporal-coHERent long-forM understanding with Episodes and Semantics ICCV 2025
Semi-Clairvoyant Scheduling of Speculative Decoding Requests to Minimize LLM Inference Latency IJCAI 2025
LLM Evaluate: An Industry-Focused Evaluation Tool for Large Language Models COLING 2025
CATO: End-to-End Optimization of ML-Based Traffic Analysis Pipelines NSDI 2025
Does quantization affect models’ performance on long-context tasks? EMNLP 2025
AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising NIPS 2024
Sparse High Rank Adapters NIPS 2024
CQIL: Inference Latency Optimization with Concurrent Computation of Quasi-Independent Layers ACL 2024
HuBERT-EE: Early Exiting HuBERT for Efficient Speech Recognition INTERSPEECH 2024
Enhancing Training of Spiking Neural Network with Stochastic Latency AAAI 2024
Learning to Compress Prompt in Natural Language Formats NAACL 2024
EC-SNN: Splitting Deep Spiking Neural Networks for Edge Devices IJCAI 2024
Distilling Autoregressive Models to Obtain High-Performance Non-autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed AAAI 2024
FanLoRA: Fantastic LoRAs and Where to Find Them in Large Language Model Fine-tuning EMNLP 2024
Kraken: Inherently Parallel Transformers For Efficient Multi-Device Inference NIPS 2024
Adaptive Depth Networks with Skippable Sub-Paths NIPS 2024
Efficient Latency-Aware CNN Depth Compression via Two-Stage Dynamic Programming ICML 2023
Gradient-Free Structured Pruning with Unlabeled Data ICML 2023
UPSCALE: Unconstrained Channel Pruning ICML 2023
Parameter-Efficient Fine-Tuning without Introducing New Latency ACL 2023
Recurrent Vision Transformers for Object Detection With Event Cameras CVPR 2023
MobileOne: An Improved One Millisecond Mobile Backbone CVPR 2023
A Multi-dimensional Evaluation of Tokenizer-free Multilingual Pretrained Models EACL 2023
A Survey for Efficient Open Domain Question Answering ACL 2023
Alternating Updates for Efficient Transformers NIPS 2023