← formats

Pairwise preference

Two candidate continuations from one state, with an ordering.

rlhf-pairwise.json8 / 8 trajectories

Samples