The Text REtrieval Conference (TREC)

Ellen Voorhees • Location: Conference Room and Online • Back to Haystack 2021

The TREC project at the National Institute of Standards and Technology has created standard test sets and evaluation methodology to support the development of methods for content-based access to material structured for human consumption since 1992. Starting with (massive-for-the-time) two gigabytes of newswire text and progressing to web-scale data collections, TREC has examined a variety of tasks including question answering, retrieving digital video, web search, legal discovery, secondary use of electronic health records, and sentiment analysis in blogs and tweets. TREC’s "coopetition" paradigm emphasizes individual experiments evaluated on a benchmark task. This has had three major impacts: improved effectiveness of information access algorithms; cross-fertilization of ideas across research groups with the eventual transfer of technology into products; and the formation of new research areas enabled by the construction of critical infrastructure.

Download the Slides Watch the Video

Ellen Voorhees

Ellen Voorhees is a Fellow at the US National Institute of Standards and Technology (NIST). Her primary responsibility at NIST is to manage the Text REtrieval Conference (TREC, project, a long-running NIST program to build the infrastructure required to do large-scale evaluation of search systems. Her research focuses on developing and validating appropriate evaluation schemes to measure system effectiveness for diverse user tasks. Voorhees is a fellow of the ACM, a member of the ACM SIGIR Academy, and has been elected as a fellow of the Washington Academy of Sciences.