Skip to content
conftrace_

edge inference

12 papers

Explore in graph

Co-occurring keywords · papers mentioning both

model compression (7) edge computing (3) large language model (2) memory efficiency (2) convolutional neural network (2) bit-width allocation (1) small language model (1) 1-bit large language model (1) ternary weight (1) pointer-generator network (1)

Papers

Bitnet.cpp: Efficient Edge Inference for Ternary LLMs ACL 2025 Token Level Routing Inference System for Edge Devices ACL 2025 Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge AAAI 2024 Efficiently Distilling LLMs for Edge Applications NAACL 2024 TinyLUT: Tiny Look-Up Table for Efficient Image Restoration at the Edge NeurIPS 2024 Efficient Edge Inference by Selective Query ICLR 2023 Gemel: Model Merging for Memory-Efficient, Real-Time Video Analytics at the Edge NSDI 2023 SiD-WaveFlow: A Low-Resource Vocoder Independent of Prior Knowledge Interspeech 2022 Block-wise Word Embedding Compression Revisited: Better Weighting and Structuring EMNLP 2021 Rethinking Differentiable Search for Mixed-Precision Neural Networks CVPR 2020 RNNPool: Efficient Non-linear Pooling for RAM Constrained Inference NeurIPS 2020 ShanghaiTech at MRP 2019: Sequence-to-Graph Transduction with Second-Order Edge Inference for Cross-Framework Meaning Representation Parsing CoNLL 2019