Preference Ranking

Preference ranking asks humans to order or choose between model responses. Rankings become training signal for preference models and RLHF pipelines.