conftrace_

model inference

39 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) inference optimization (219) efficient computing (781) neural network optimization (1293) mixture of expert (640) speculative decoding (111) knowledge distillation (3725) language model (4599) parameter efficiency (417)

Papers

Elevating AI on the Edge: A Demonstration of MIMaaS (Machine Intelligence with Microcontroller-as-a-Service) AAAI 2026
SMIDT: High-Performance Inference Framework for MoE Models with Dynamic Top-K Routing AAAI 2026
SpecDiff: Accelerating Diffusion Model Inference with Self-Speculation AAAI 2026
WaferLLM: Large Language Model Inference at Wafer Scale OSDI 2025
Energy Considerations of Large Language Model Inference and Efficiency Optimizations ACL 2025
FastPoint: Accelerating 3D Point Cloud Model Inference via Sample Point Distance Prediction ICCV 2025
BigMac: A Communication-Efficient Mixture-of-Experts Model Structure for Fast Training and Inference AAAI 2025
Hardware-Aware Parallel Prompt Decoding for Memory-Efficient Acceleration of LLM Inference EMNLP 2025
Dovetail: A CPU/GPU Heterogeneous Speculative Decoding for LLM inference EMNLP 2025
On Probabilistic Truncation in Privacy-preserving Machine Learning AAAI 2025
Normalized Narrow Jump To Conclusions: Normalized Narrow Shortcuts for Parameter Efficient Early Exit Transformer Prediction EMNLP 2024
NeuralFuse: Learning to Recover the Accuracy of Access-Limited Neural Network Inference in Low-Voltage Regimes NIPS 2024
SpecExec: Massively Parallel Speculative Decoding For Interactive LLM Inference on Consumer Devices NIPS 2024
Whispers that Shake Foundations: Analyzing and Mitigating False Premise Hallucinations in Large Language Models EMNLP 2024
ServerlessLLM: Low-Latency Serverless Inference for Large Language Models OSDI 2024
SimSCOOD: Systematic Analysis of Out-of-Distribution Generalization in Fine-tuned Source Code Models NAACL 2024
Learning Broadcast Protocols AAAI 2024
CHESS: Optimizing LLM Inference via Channel-Wise Thresholding and Selective Sparsification EMNLP 2024
Fast and Accurate Binary Neural Networks Based on Depth-Width Reshaping AAAI 2023
Improving the Robustness of Summarization Models by Detecting and Removing Input Noise EMNLP 2023
PuMer: Pruning and Merging Tokens for Efficient Vision Language Models ACL 2023
RGB No More: Minimally-Decoded JPEG Vision Transformers CVPR 2023
SAMP: A Model Inference Toolkit of Post-Training Quantization for Text Processing via Self-Adaptive Mixed-Precision EMNLP 2023
A Holistic Assessment of the Carbon Footprint of Noor, a Very Large Arabic Language Model ACL 2022
DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale ICML 2022