Mohammad Rastegari

SeedLM: Compressing LLM Weights into Seeds of Pseudo-Random Generators ICLR 2025 Speculative Streaming: Efficient and Scalable Speculative Decoding with Multi-Stream Attention EMNLP 2025 Knowledge Transfer from Vision Foundation Models for Efficient Training of Small Task-specific Models ICML 2024 KV-Runahead: Scalable Causal LLM Inference by Parallel Key-Value Cache Generation ICML 2024 LLM in a flash: Efficient Large Language Model Inference with Limited Memory ACL 2024 ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models ICLR 2024 Superposition Prompting: Improving and Accelerating Retrieval-Augmented Generation ICML 2024 LCS: Learning Compressible Subspaces for Efficient, Adaptive, Real-Time Network Compression at Inference Time WACV 2023 Reinforce Data, Multiply Impact: Improved Model Accuracy and Robustness with Dataset Reinforcement ICCV 2023 Token Pooling in Vision Transformers for Image Classification WACV 2023 DKM: Differentiable k-Means Clustering Layer for Neural Network Compression ICLR 2022 MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer ICLR 2022 SPIN: An Empirical Evaluation on Sharing Parameters of Isotropic Networks ECCV 2022 Learning Neural Network Subspaces ICML 2021 Butterfly Transform: An Efficient FFT Based Neural Architecture Design CVPR 2020 DeFINE: Deep Factorized Input Token Embeddings for Neural Sequence Modeling ICLR 2020 Supermasks in Superposition NeurIPS 2020 What's Hidden in a Randomly Weighted Neural Network? CVPR 2020 Assisted Excitation of Activations: A Learning Technique to Improve Object Detectors CVPR 2019 Discovering Neural Wirings NeurIPS 2019 ELASTIC: Improving CNNs With Dynamic Scaling Policies CVPR 2019 ESPNetv2: A Light-Weight, Power Efficient, and General Purpose Convolutional Neural Network CVPR 2019 Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learning CVPR 2019 OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledge CVPR 2019 Two Body Problem: Collaborative Visual Task Completion CVPR 2019 ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation ECCV 2018 IQA: Visual Question Answering in Interactive Environments CVPR 2018 Pyramidal Recurrent Unit for Language Modeling EMNLP 2018 LCNN: Lookup-Based Convolutional Neural Network CVPR 2017 G-CNN: An Iterative Grid Based Object Detector CVPR 2016 Newtonian Scene Understanding: Unfolding the Dynamics of Objects in Static Images CVPR 2016 Class Consistent Multi-Modal Fusion With Binary Features CVPR 2015 Computationally Bounded Retrieval CVPR 2015 Discriminative and Consistent Similarities in Instance-Level Multiple Instance Learning CVPR 2015 Adding Unlabeled Samples to Categories by Learned Attributes CVPR 2013 Domain Adaptive Classification ICCV 2013 Multi-attribute Queries: To Merge or Not to Merge? CVPR 2013 Predictable Dual-View Hashing ICML 2013