Hybrid search Lessons learned
Tom Burgmans and Mohit Sidana • Location: TUECHTIG • Back to Haystack EU 2024
Designing hybrid search solutions requires decision-making. Not only is it a balancing act to find the right hardware resources but also choosing what to research when the team capacity is limited. In this talk we’ll explain designing a system that works for both RAG and conventional search use cases. We’ll zoom in on the re-usable nature of a nested index structure, how to build hybrid queries, how to control latency, how to tune relevance for an LLM, how to manage costs and other practical aspects that a search team has to deal with. This is also a story about rolling out a new way of information retrieval in an organization that has traditionally relied on keyword matching. Hybrid search doesn’t sell itself, needs to be explained and well prototyped. Join this session, learn about our lessons learned and walk away with practical strategies, real-world examples, and pitfalls to avoid when bringing hybrid search into production in enterprise environments.
Tom Burgmans
Wolters Kluwer
Mohit Sidana
Wolters Kluwer