← formats

Stepwise preference

One step, scored, with the correction a researcher would make.

rlhf-stepwise.json8 / 8 trajectories

Samples