Tagged
#pretraining
2 articles
models
How large language models are trained, in plain language
Training a language model happens in stages, not one magic step. Here is what each stage does, in plain language, and why the order matters.
#training#pretraining#fine-tuning
06-01 12:06·7 min read
research
Pretraining vs fine-tuning vs alignment
Three words get blurred together when people describe how models are made. They are different stages with different jobs. Here is what each one does.
#pretraining#fine-tuning#alignment
04-08 17:04·7 min read