Mohammad Rastegari

38 papers · 2013–2025 · 9 conferences · across top CS/AI conferences

Achievements

+12 more ↓

🏃 Academic Marathon (12) 🌍 Conference Polyglot (9) 🧭 Keyword Pioneer 🌉 Interdisciplinary Bridge 🐣 Hot Topic Early Bird

🧭 Keyword Pioneer 🐣 Hot Topic Early Bird 🌍 Conference Polyglot (9) 🤝 Dynamic Duo (17) 🌱 Topic Pioneer 💎 Century Club (38) 🚀 Conference Pioneer 🗃️ Keyword Collector (150) ⚡ Prolific Year (5) 📈 Trend Setter ❓ The Questioner (2) 🔥 Unstoppable (11)

Conferences

CVPR (17) ICLR (5) ICML (5) ECCV (2) EMNLP (2) ICCV (2) NIPS (2) WACV (2) ACL (1)

Top co-authors

Ali Farhadi (17) Sachin Mehta (10) Aniruddha Kembhavi (5) Hannaneh Hajishirzi (5) Mitchell Wortsman (5) Mehrdad Farajtabar (4) Anish Prabhu (4) Mahyar Najibi (4) Oncel Tuzel (4) Maxwell Horton (3)

Keywords

convolutional neural network (6) model compression (4) image classification (4) neural network (3) object detection (3) visual question answering (2) neural network optimization (2) efficient computing (2) computational efficiency (2) semantic segmentation (2) neural architecture search (2) scene understanding (2) unsupervised learning (2) language modeling (2) efficient inference (2) few-shot learning (1) adversarial robustness (1) vision transformer (1) semi-supervised learning (1) representation learning (1)

Papers

SeedLM: Compressing LLM Weights into Seeds of Pseudo-Random Generators ICLR 2025 Speculative Streaming: Efficient and Scalable Speculative Decoding with Multi-Stream Attention EMNLP 2025 KV-Runahead: Scalable Causal LLM Inference by Parallel Key-Value Cache Generation ICML 2024 LLM in a flash: Efficient Large Language Model Inference with Limited Memory ACL 2024 Knowledge Transfer from Vision Foundation Models for Efficient Training of Small Task-specific Models ICML 2024 Superposition Prompting: Improving and Accelerating Retrieval-Augmented Generation ICML 2024 ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models ICLR 2024 Reinforce Data, Multiply Impact: Improved Model Accuracy and Robustness with Dataset Reinforcement ICCV 2023 Token Pooling in Vision Transformers for Image Classification WACV 2023 LCS: Learning Compressible Subspaces for Efficient, Adaptive, Real-Time Network Compression at Inference Time WACV 2023 DKM: Differentiable k-Means Clustering Layer for Neural Network Compression ICLR 2022 MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer ICLR 2022 SPIN: An Empirical Evaluation on Sharing Parameters of Isotropic Networks ECCV 2022 Learning Neural Network Subspaces ICML 2021 What's Hidden in a Randomly Weighted Neural Network? CVPR 2020 Supermasks in Superposition NIPS 2020 Butterfly Transform: An Efficient FFT Based Neural Architecture Design CVPR 2020 DeFINE: Deep Factorized Input Token Embeddings for Neural Sequence Modeling ICLR 2020 OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledge CVPR 2019 ESPNetv2: A Light-Weight, Power Efficient, and General Purpose Convolutional Neural Network CVPR 2019 ELASTIC: Improving CNNs With Dynamic Scaling Policies CVPR 2019 Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learning CVPR 2019 Discovering Neural Wirings NIPS 2019 Two Body Problem: Collaborative Visual Task Completion CVPR 2019 Assisted Excitation of Activations: A Learning Technique to Improve Object Detectors CVPR 2019 IQA: Visual Question Answering in Interactive Environments CVPR 2018 ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation ECCV 2018 Pyramidal Recurrent Unit for Language Modeling EMNLP 2018 LCNN: Lookup-Based Convolutional Neural Network CVPR 2017 Newtonian Scene Understanding: Unfolding the Dynamics of Objects in Static Images CVPR 2016 G-CNN: An Iterative Grid Based Object Detector CVPR 2016 Computationally Bounded Retrieval CVPR 2015 Discriminative and Consistent Similarities in Instance-Level Multiple Instance Learning CVPR 2015 Class Consistent Multi-Modal Fusion With Binary Features CVPR 2015 Domain Adaptive Classification ICCV 2013 Predictable Dual-View Hashing ICML 2013 Adding Unlabeled Samples to Categories by Learned Attributes CVPR 2013 Multi-attribute Queries: To Merge or Not to Merge? CVPR 2013