A Complete Tutorial on Off-Policy Evaluation for Recommender Systems

How to reduce the offline-online evaluation gap

A recommender system jumping through the offline-online evaluation gap (AI-generated image)

Introduction

In this tutorial, I will give some rationales about why one should care about off-policy evaluation. Then I’ll introduce the right amount of theory on the matter. I will not dive too deep into the latest methods and stop on…