RLHF
Reinforcement learning from human feedback: training a model using human preference ratings of its outputs.
People compare model responses; those preferences train a reward model, which is then used to optimize the language model toward responses people prefer.
Related: Fine-tuning, Alignment