Million Query Track 2007 Overview

Citations Over Time

Abstract

The Million Query (1MQ) track ran for the second time in TREC 2008.The track is designed to serve two purposes: first, it is an exploration of ad-hoc retrieval over a large set of queries and a large collection of documents; second, it investigates questions of system evaluation, in particular whether it is better to evaluate using many shallow judgments or fewer thorough judgments.As with the 2007 track [ACA + 07], participants ran 10,000 queries against a collection of 25 million documents.The 2008 track differed in the following ways:1. Queries were assigned to one of four categories.2. Each query was assigned a target of 8, 16, 32, 64, or 128 judgments.3. Assessors could judge documents "not relevant but reasonable".

Related Papers

• → Semantic-based Structural and Content indexing for the efficient retrieval of queries over large XML data repositories(2014)14 cited
• → Context Disambiguation Based Semantic Web Search for Effective Information Retrieval(2011)5 cited
• → An intelligent information retrieval agent(2008)15 cited
• → Investigating the combination of structural and textual information about multimedia retrieval(2014)
• Method of Adaptive Semantic Web Retrieval(2011)