← Authors

Mohammad Rastegari

38 papers · 2013–2025 · 9 conferences · across top CS/AI conferences

Achievements

πŸƒ Academic Marathon (12) πŸ—ΊοΈ Taxonomy Completionist (68) 🌈 Renaissance Researcher (8) 🐝 Cross-Pollinator (10) πŸŒ‰ Interdisciplinary Bridge 🧭 Keyword Pioneer 🐣 Hot Topic Early Bird 🌍 Conference Polyglot (9) 🀝 Dynamic Duo (17) 🌱 Topic Pioneer πŸ’Ž Century Club (38) πŸš€ Conference Pioneer πŸ—ƒοΈ Keyword Collector (150) ⚑ Prolific Year (5) πŸ“ˆ Trend Setter ❓ The Questioner (2) πŸ”₯ Unstoppable (11)

Conferences

CVPR (17) ICLR (5) ICML (5) ECCV (2) EMNLP (2) ICCV (2) NIPS (2) WACV (2) ACL (1)

Top co-authors

Ali Farhadi (17) Sachin Mehta (10) Aniruddha Kembhavi (5) Hannaneh Hajishirzi (5) Mitchell Wortsman (5) Mehrdad Farajtabar (4) Anish Prabhu (4) Mahyar Najibi (4) Oncel Tuzel (4) Maxwell Horton (3)

Keywords

convolutional neural network (6) model compression (4) image classification (4) neural network (3) object detection (3) visual question answering (2) neural network optimization (2) efficient computing (2) computational efficiency (2) semantic segmentation (2) neural architecture search (2) scene understanding (2) unsupervised learning (2) language modeling (2) efficient inference (2) few-shot learning (1) adversarial robustness (1) vision transformer (1) semi-supervised learning (1) representation learning (1)

Papers

SeedLM: Compressing LLM Weights into Seeds of Pseudo-Random Generators ICLR 2025
Speculative Streaming: Efficient and Scalable Speculative Decoding with Multi-Stream Attention EMNLP 2025
KV-Runahead: Scalable Causal LLM Inference by Parallel Key-Value Cache Generation ICML 2024
LLM in a flash: Efficient Large Language Model Inference with Limited Memory ACL 2024
Knowledge Transfer from Vision Foundation Models for Efficient Training of Small Task-specific Models ICML 2024
Superposition Prompting: Improving and Accelerating Retrieval-Augmented Generation ICML 2024
ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models ICLR 2024
Reinforce Data, Multiply Impact: Improved Model Accuracy and Robustness with Dataset Reinforcement ICCV 2023
Token Pooling in Vision Transformers for Image Classification WACV 2023
LCS: Learning Compressible Subspaces for Efficient, Adaptive, Real-Time Network Compression at Inference Time WACV 2023
DKM: Differentiable k-Means Clustering Layer for Neural Network Compression ICLR 2022
MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer ICLR 2022
SPIN: An Empirical Evaluation on Sharing Parameters of Isotropic Networks ECCV 2022
Learning Neural Network Subspaces ICML 2021
What's Hidden in a Randomly Weighted Neural Network? CVPR 2020
Supermasks in Superposition NIPS 2020
Butterfly Transform: An Efficient FFT Based Neural Architecture Design CVPR 2020
DeFINE: Deep Factorized Input Token Embeddings for Neural Sequence Modeling ICLR 2020
OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledge CVPR 2019
ESPNetv2: A Light-Weight, Power Efficient, and General Purpose Convolutional Neural Network CVPR 2019
ELASTIC: Improving CNNs With Dynamic Scaling Policies CVPR 2019
Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learning CVPR 2019
Discovering Neural Wirings NIPS 2019
Two Body Problem: Collaborative Visual Task Completion CVPR 2019
Assisted Excitation of Activations: A Learning Technique to Improve Object Detectors CVPR 2019
IQA: Visual Question Answering in Interactive Environments CVPR 2018
ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation ECCV 2018
Pyramidal Recurrent Unit for Language Modeling EMNLP 2018
LCNN: Lookup-Based Convolutional Neural Network CVPR 2017
Newtonian Scene Understanding: Unfolding the Dynamics of Objects in Static Images CVPR 2016
G-CNN: An Iterative Grid Based Object Detector CVPR 2016
Computationally Bounded Retrieval CVPR 2015
Discriminative and Consistent Similarities in Instance-Level Multiple Instance Learning CVPR 2015
Class Consistent Multi-Modal Fusion With Binary Features CVPR 2015
Domain Adaptive Classification ICCV 2013
Predictable Dual-View Hashing ICML 2013
Adding Unlabeled Samples to Categories by Learned Attributes CVPR 2013
Multi-attribute Queries: To Merge or Not to Merge? CVPR 2013