A practical approach to measuring the relevance and preventing regressions

Aline Paponaud and Roudy Khoury • Location: TUECHTIG • Back to Haystack EU 2022

In this session we present a practical approach in implementing a component that automatically measures the relevance of an e-commerce search engine, helps configuring it and prevents relevance regressions. Our component is based on the Normalized Discounted Cumulative Gain (NDCG) theory and integrated into a real-world large-scale e-commerce search engine. We give our return on experience and present all the practical details of its implementation - logs collection, integration with the search engine administration interface, deployment automation and give an idea about its return on investment (ROI).

Aline Paponaud

Adelean

CTO of Adelean, working with search and providing consulting services and expertise around Elasticsearch, Lucene and Solr. She brings her energy to leveraging search engines, as they become more and more essential in every domain.

Roudy Khoury

Adelean

Roudy holds a Masters in Artificial Intelligence from Paris 12 University. He joined Adelean as a software engineer and has been most interested in the areas of search and natural language processing. He has hands on experience implementing Elasticsearch based search engine solutions in various sectors of activity. Roudy enjoys challenges and solving problems and has worked in a variety of industries.