2008 NIPS NeurIPS 2008

Predictive Indexing for Fast Search

Abstract

We tackle the computational problem of query-conditioned search. Given a machine-learned scoring rule and a query distribution, we build a predictive index by precomputing lists of potential results sorted based on an expected score of the result over future queries. The predictive index datastructure supports an anytime algorithm for approximate retrieval of the top elements. The general approach is applicable to webpage ranking, internet advertisement, and approximate nearest neighbor search. It is particularly effective in settings where standard techniques (e.g., inverted indices) are intractable. We experimentally find substantial improvement over existing methods for internet advertisement and approximate nearest neighbors.

🌉 Interdisciplinary Bridge — Computer Science and Data Science & Analytics and Machine Learning
📈 Trend Setter — Efficient Computing
🧭 Keyword Pioneer — predictive indexing
🐝 Cross-Pollinator — Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Machine Learning, Mathematics & Optimization, Speech & Audio
🌱 Topic Pioneer — Retrieval
🐣 Hot Topic Early Bird — nearest neighbor search