Skip to content
conftrace_

deep learning inference

7 papers

Explore in graph

Co-occurring keywords · papers mentioning both

inference optimization (2) memory optimization (2) pipelined context switching (1) gpu sharing (1) model transmission (1) precision optimization (1) code education (1) rubric sampling (1) gpu task scheduling (1) scheduling overhead (1)

Papers

AutoChunk: Automated Activation Chunk for Memory-Efficient Deep Learning Inference ICLR 2024 Be Like Water: Adaptive Floating Point for Machine Learning ICML 2022 LightSeq: A High Performance Inference Library for Transformers NAACL 2021 AdaTune: Adaptive Tensor Program Compilation Made Efficient NeurIPS 2020 Nimble: Lightweight and Parallel GPU Task Scheduling for Deep Learning NeurIPS 2020 PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications OSDI 2020 Zero Shot Learning for Code Education: Rubric Sampling with Deep Learning Inference AAAI 2019