Tagged

#fine-tuning

5 articles

Catastrophic forgetting and continual learning

Teach a neural network something new and it tends to forget what it knew. This stubborn problem is why models learn in big batches, not in a stream.

#continual-learning#forgetting#training

06-06 13:46·7 min read

models

How large language models are trained, in plain language

Training a language model happens in stages, not one magic step. Here is what each stage does, in plain language, and why the order matters.

#training#pretraining#fine-tuning

06-01 12:06·7 min read

research

What RLHF actually does

RLHF is the step that turns a raw text predictor into something you can talk to. Here is what it actually changes — and, just as importantly, what it does not.

#rlhf#alignment#fine-tuning

05-25 15:07·7 min read

research

Fine-tuning vs RAG vs prompting: a decision guide

Three ways to make a model do what you want — and most teams reach for the heaviest one first. Here is how to choose in the right order.

#fine-tuning#rag#prompting

04-20 10:42·7 min read

research

Pretraining vs fine-tuning vs alignment

Three words get blurred together when people describe how models are made. They are different stages with different jobs. Here is what each one does.

#pretraining#fine-tuning#alignment

04-08 17:04·7 min read