2008 NIPS NeurIPS 2008

Estimating Robust Query Models with Convex Optimization

Abstract

Query expansion is a long-studied approach for improving retrieval effectiveness by enhancing the user’s original query with additional related terms. Current algorithms for automatic query expansion have been shown to consistently improve retrieval accuracy on average, but are highly unstable and have bad worst-case performance for individual queries. We introduce a novel risk framework that formulates query model estimation as a constrained metric labeling problem on a graph of term relations. Themodel combines assignment costs based on a baseline feedback algorithm, edge weights based on term similarity, and simple constraints to enforce aspect balance, aspect coverage, and term centrality. Results across multiple standard test collections show consistent and dramatic reductions in the number and magnitude of expansion failures, while retaining the strong positive gains of the baseline algorithm.

🌉 Interdisciplinary Bridge — Computer Science and Machine Learning and Mathematics & Optimization
📈 Trend Setter — Risk Management
🧭 Keyword Pioneer — risk management
🐣 Hot Topic Early Bird — convex optimization
🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy, Speech & Audio
🌱 Topic Pioneer — Information Retrieval