conftrace_

gpu optimization

27 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) gpu acceleration (44) efficient computing (781) knowledge distillation (3725) convolutional neural network (4226) neural machine translation (2310) attention mechanism (4001) latency optimization (119) language model inference (18)

Papers

PipeThreader: Software-Defined Pipelining for Efficient DNN Execution OSDI 2025
SpikePack: Enhanced Information Flow in Spiking Neural Networks with High Hardware Compatibility ICCV 2025
SEP: A General Lossless Compression Framework with Semantics Enhancement and Multi-Stream Pipelines IJCAI 2025
Accelerating Adversarial Training on Under-Utilized GPU IJCAI 2025
Dynamic Operator Optimization for Efficient Multi-Tenant LoRA Model Serving AAAI 2025
QiMeng-Attention: SOTA Attention Operator is generated by SOTA Attention Algorithm ACL 2025
QiMeng-GEMM: Automatically Generating High-Performance Matrix Multiplication Code by Exploiting Large Language Models AAAI 2025
BASS: Batched Attention-optimized Speculative Sampling ACL 2024
SS1: Accelerating Inference with Fast and Expressive Sketch Structured Transform NIPS 2024
USHER: Holistic Interference Avoidance for Resource Optimized ML Inference OSDI 2024
FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision NIPS 2024
Optimized Speculative Sampling for GPU Hardware Accelerators EMNLP 2024
Boost Transformer-based Language Models with GPU-Friendly Sparsity and Quantization ACL 2023
Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Training NSDI 2023
Simple Hardware-Efficient Long Convolutions for Sequence Modeling ICML 2023
Improving WaveRNN with Heuristic Dynamic Blending for Fast and High-Quality GPU Vocoding INTERSPEECH 2023
Optimized Crystallographic Graph Generation for Material Science IJCAI 2023
RTFormer: Efficient Design for Real-Time Semantic Segmentation with Transformer NIPS 2022
Searching the Deployable Convolution Neural Networks for GPUs CVPR 2022
Findings of the WMT 2022 Shared Task on Efficient Translation EMNLP 2022
Easy and Efficient Transformer: Scalable Inference Solution For Large NLP Model NAACL 2022
LightSeq: A High Performance Inference Library for Transformers NAACL 2021
Marian: Cost-effective High-Quality Neural Machine Translation in C++ ACL 2018
Deep Tensor Convolution on Multicores ICML 2017
Unfolding and Shrinking Neural Machine Translation Ensembles EMNLP 2017