conftrace_

memory bandwidth

8 papers

Explore in graph

Co-occurring keywords

model compression (3302) packet processing (34) receive ring (2) transformer architecture (1560) sliding window attention (7) cuda kernel (3) fused kernel (1) network throughput (18) throughput improvement (14) network interface card (11)

Papers

Accelerating LLM Inference Throughput via Asynchronous KV Cache Prefetching AAAI 2026
Disentangling the Dual Role of NIC Receive Rings OSDI 2025
Scaling Laws and Efficient Inference for Ternary Language Models ACL 2025
Faster Neighborhood Attention: Reducing the O(n^2) Cost of Self Attention at the Threadblock Level NIPS 2024
FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference ACL 2023
ShRing: Networking with Shared Receive Rings OSDI 2023
Post training 4-bit quantization of convolutional networks for rapid-deployment NIPS 2019
Memory-Efficient Modeling and Search Techniques for Hardware ASR Decoders INTERSPEECH 2016