Machine Learning Section 011

Validation and Hyperparameter Search

How to measure a model honestly, and how to find good settings without burning a week of compute.

8 of 8 lessons published Three reading levels on every lesson

Start with “K-fold cross-validation”

Lessons in order

Work top to bottom. Each lesson assumes the one above it.

  1. K-fold cross-validation
  2. Grid search
  3. Random search
  4. Bayesian optimisation
  5. Successive halving and Hyperband
  6. Optuna
  7. Learning curves
  8. AIC and BIC