conftrace_

edge inference

11 papers

Explore in graph

Co-occurring keywords

model compression (3302) edge computing (210) large language model (13587) memory efficiency (261) convolutional neural network (4226) matrix multiplication (41) video analytics (14) gpu memory (17) layer sharing (2) memory management (43)

Papers

Token Level Routing Inference System for Edge Devices ACL 2025
Bitnet.cpp: Efficient Edge Inference for Ternary LLMs ACL 2025
Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge AAAI 2024
Efficiently Distilling LLMs for Edge Applications NAACL 2024
TinyLUT: Tiny Look-Up Table for Efficient Image Restoration at the Edge NIPS 2024
Gemel: Model Merging for Memory-Efficient, Real-Time Video Analytics at the Edge NSDI 2023
SiD-WaveFlow: A Low-Resource Vocoder Independent of Prior Knowledge INTERSPEECH 2022
Block-wise Word Embedding Compression Revisited: Better Weighting and Structuring EMNLP 2021
Rethinking Differentiable Search for Mixed-Precision Neural Networks CVPR 2020
RNNPool: Efficient Non-linear Pooling for RAM Constrained Inference NIPS 2020
ShanghaiTech at MRP 2019: Sequence-to-Graph Transduction with Second-Order Edge Inference for Cross-Framework Meaning Representation Parsing CONLL 2019