Search quality evaluation: tools and techniques
Torsten Köster & Fabian Klenk & René Kriegler • Back to Haystack Europe 2018
Every search engineer ordinarily struggles with the task of evaluating how well a search engine is performing. Improving the correctness and effectiveness of a search system requires a set of tools which help measuring the direction where the system is going. The talk will describe the Rated Ranking Evaluator from a developer perspective. RRE is an open source search quality evaluation tool, that could be used for producing a set of deliverable reports and that could be integrated within a continuous integration infrastructure. Building on the introduction, we’ll present the latest integrations and developments happening around RRE including the User Interactions Logger, Training Set Builder for LTR integrations, versions filtering and persistence & improved domain model manageability.
Download the SlidesAlessandro Benedetti is a Search Consultant and R&D Software Engineer at Sease Ltd. His focus is on information retrieval, information extraction, natural language processing, and machine learning. At Sease Alessandro is working as a freelance on Search/Machine learning projects and consultancies. When he isn't on clients projects, he is actively contributing to the open source community and presenting the applications of leading edge techniques in real world scenarios at meetups and conferences such as ECIR, the Lucene/Solr Revolution, ApacheCon and Open Source Summit.
Andrea Gazzarini is a curious software engineer, mainly focused on the Java language and passionate about search technologies. With more than 15 years of experience in various software engineering areas, his adventure with the search domain began in 2010, when he met Apache Solr. Since then, he has been involved in many projects, across different fields. He's an open-source lover; he's currently involved in several (too many!) projects, always thinking about a "big" idea that will change his (developer) life.