RLHF

How it is used

Part of post-training, after pretraining and supervised fine-tuning. It played a big role in making chat models more helpful and polite. Related methods include RLAIF, where AI feedback replaces some human feedback, and DPO, which learns from preferences without a separate reward model.

Example sentences

1. After RLHF, our testers rated the model's answers as much more helpful.

2. We worked with medical experts to rank answers for the RLHF data.

Common collocations

• RLHF stage
• reward model
• human preference data
• preference tuning

Related terms

• reinforcement learningA type of machine learning in which an agent learns by trial and error, taking actions in an environment and receiving rewards or penalties for the results.
• alignmentMaking an AI system's behavior match human intentions and values, so that it is helpful and honest and avoids causing harm. Also the research field that studies this.
• fine-tuningExtra training of an already pretrained model on a smaller, task-specific dataset, so that it does better on that task or follows a particular style.
• pretrainingThe first and largest training stage, in which a model learns general patterns from a huge amount of mostly unlabeled data before it is adapted to specific tasks.

This word in other fields

The same English word can have a different meaning in another field:

• RLHF · Software Engineering

More terms: Fine-Tuning and Adaptation

• transfer learning
• base model
• LoRA
• knowledge distillation