Deep Learning Section 035

Checkpoints, Export and Inference

Saving a model so it loads again, and getting it out of your training script in one piece.

7 of 7 lessons published Three reading levels on every lesson

Start with “What a state_dict really is”

Lessons in order

Work top to bottom. Each lesson assumes the one above it.

  1. What a state_dict really is
  2. Resuming training exactly where it stopped
  3. Fixing missing and unexpected keys
  4. Why torch.load can run code, and safetensors
  5. Exponential moving average of weights
  6. TorchScript: tracing vs scripting
  7. torch.export and the ExportedProgram