Observability in Search: Measuring and Improving Relevance

Observability in Search: Measuring and Improving Relevance

Whether we want to feed good results to LLMs (in RAG) or to improve E-commerce search or recommendations, we need to know what to measure (metrics) and how to measure (tools and data). We’ll look at how to measure precision, recall, NDCG, and related metrics over judgment lists (yes, you can use LLMs to generate them) using various relevance-testing and relevance-improving tools and methods.