Making the case for human judgement relevance testing

Tara Diedrichsen and Tito Sierra • Location: Theater 5Back to Haystack 2019

View the Slides View the Video

Supporting a robust relevance testing programme using human judges represents a significant investment in terms of time and resources. However, when executed well the outputs can quickly become an invaluable tool and important motivator not just for search relevance engineers, but for product teams and other business stakeholders.

This talk will explore what makes a successful human relevance testing programme that ultimately speaks for itself in terms of return on investment. It will cover:

Tara Diedrichsen


Tara Diedrichsen is a Senior Global Product Manager in the Global Product Team at LexisNexis. She works with product teams around the global on search optimization, including the adoption of new search algorithms as well new metrics and testing methods. In this capacity she manages the human judgement relevance testing program at LexisNexis globally.

Tito Sierra