← Back to modules

LLM Training Pipeline

Pretraining objective, data curation, scaling laws, Chinchilla, AdamW, LR schedules, mixed precision, distributed training, SFT, RLHF, DPO, training evaluation.

Core50 questions
Free account

Take the full module

These are the first few of 50 questions. A free account opens the rest as a scored drill.

  • Every question in this module
  • Instant feedback and supporting reading
  • Your score and progress, saved

Free · your email is used for progress only.