Fast Feature Selection for Learning to Rank
Accepted at ICTIR ’16: International Conference on the Theory of Information Retrieval .
Abstract. An emerging research area named Learning-to-Rank (LtR) has shown that eﬀective solutions to the ranking problem can leverage machine learning techniques applied to a large set of features capturing the relevance of a candidate document for the user query. Large-scale search systems must however answer user queries very fast, and the computation of the features for candidate documents must comply with strict back-end latency constraints. The number of features cannot thus grow beyond a given limit, and Feature Selection (FS) techniques have to be exploited to ﬁnd a subset of features that both meets latency requirements and leads to high eﬀectiveness of the trained models.
In this paper, we propose three new algorithms for FS speciﬁcally designed for the LtR context where hundreds of continuous or categorical features can be involved. We present a comprehensive experimental analysis conducted on publicly available LtR datasets and we show that the proposed strategies outperform a well-known state-of-the-art competitor.