Tagged
#rlhf
2 articles
models
How large language models are trained, in plain language
Training a language model happens in stages, not one magic step. Here is what each stage does, in plain language, and why the order matters.
#training#pretraining#fine-tuning
06-01 12:06·7 min read
research
What RLHF actually does
RLHF is the step that turns a raw text predictor into something you can talk to. Here is what it actually changes — and, just as importantly, what it does not.
#rlhf#alignment#fine-tuning
05-25 15:07·7 min read